Visualize GitHub Copilot metrics

This guide demonstrates how to set up a monitoring dashboard to gain insights into your GitHub Copilot usage using Port. You'll learn how to visualize key metrics like acceptance rates, active users, chat productivity, and track team adoption over time.

Available Github Integrations

This guide includes one or more steps that require integration with GitHub.
Port supports two GitHub integrations:

• GitHub (Legacy) - uses a GitHub app, which is soon to be deprecated.
• GitHub (Ocean) - uses the Ocean framework, recommended for new integrations.

Both integration options are present in this guide via tabs, choose the one that fits your needs.

Common use cases

• Monitor Copilot usage trends and adoption across teams.
• Track code suggestion acceptance rates to measure productivity gains.
• Analyze chat productivity and user engagement with Copilot.
• Report on ROI of GitHub Copilot investment to leadership.

Prerequisites

This guide assumes the following:

• You have a Port account and have completed the onboarding process.
• Port's GitHub integration or Port's GitHub Ocean integration is installed in your account.
• The GitHub Copilot integration is installed and syncing data.

Create the dashboard

1. Navigate to your software catalog.

2. Click on the + button in the left sidebar.

3. Select New dashboard.

4. Name the dashboard Copilot Insights.

5. Input Monitor Copilot usage and performance metrics across teams under Description.

6. Select the Github icon.

7. Click Create.

You now have a blank dashboard where you can add widgets to visualize your GitHub Copilot metrics.

Add widgets

Create the following widgets to gain insights into your GitHub Copilot usage. Select the tab that matches your integration type for the correct blueprint and property names.

GitHub (Legacy)

Total active users widget

Total active users (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Total Active Users (Avg).
   • Description: Average number of active users using Copilot per day.
   • Icon: Users.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate by property.
   • Property: total_active_users.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: users.

3. Click Save.

Overall acceptance rate widget

Overall acceptance rate (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Overall Acceptance Rate (%).
   • Description: How often Copilot suggestions are accepted.
   • Icon: metric.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate by property.
   • Property: acceptance_rate.
   • Function: Average.
   • Average of: total.
   • Unit: %.

3. Click Save.

Total suggestions generated widget

Total suggestions generated (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Total Suggestions Generated.
   • Description: Average suggested lines of code per day.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate by property.
   • Property: total_lines_suggested.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: suggested lines of code.

3. Click Save.

Chat productivity widget

Chat productivity (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Chat Productivity.
   • Description: Average chat turns per day.
   • Icon: Chat.
   • Blueprint: github_copilot_usage.
   • Chart type: Select Aggregate by property.
   • Property: total_chat_turns.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: chats.

3. Click Save.

Usage by team widget

Usage by team (click to expand)

1. Click on + Widget and select Pie Chart.

2. Fill in the following details:

   • Title: Usage by Team.
   • Description: Contribution of each team to copilot usage.
   • Icon: Pie.
   • Blueprint: github_copilot_usage.
   • Breakdown by Property: git_hub_team.

3. Click Save.

Acceptance rate over time widget

Acceptance rate over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Title: Acceptance Rate Over Time. Description: See quality improvements (or declines) over time. Icon: LineChart.

3. Set X axis:

   • Title: Date.
   • Time interval: Week.
   • Time range: In the past 30 days.

4. Set Y axis title: Acceptances.

5. Click + Line and configure:

   • Title: Total acceptances.
   • Chart type: Aggregate by property.
   • Blueprint: github_copilot_usage.
   • Property: total_acceptances_count.
   • Function: Average.
   • Measure time by: createdAt.

6. Click Save.

Active users over time widget

Active users over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Title: Active Users Over Time. Description: Shows if team usage is growing. Icon: LineChart.

3. Set X axis:

   • Title: Date.
   • Time interval: Week.
   • Time range: In the past 30 days.

4. Set Y axis title: Users.

5. Click + Line and configure:

   • Title: Total active users.
   • Chart type: Aggregate by property.
   • Blueprint: github_copilot_usage.
   • Property: total_active_users.
   • Function: Average.
   • Measure time by: createdAt.

6. Click + Line and configure:

   • Title: Active chat users.
   • Chart type: Aggregate by property.
   • Blueprint: github_copilot_usage.
   • Property: total_active_chat_users.
   • Function: Average.
   • Measure time by: createdAt.

7. Click Save.

Chat productivity over time widget

Chat productivity over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Title: Chat Productivity Over Time. Description: Reveals growing reliance on Copilot Chat. Icon: LineChart.

3. Set X axis:

   • Title: Date.
   • Time interval: Week.
   • Time range: In the past 30 days.

4. Set Y axis title: Chat activity.

5. Click + Line and configure:

   • Title: Chat turns.
   • Chart type: Aggregate by property.
   • Blueprint: github_copilot_usage.
   • Property: total_chat_turns.
   • Function: Average.
   • Measure time by: createdAt.

6. Click + Line and configure:

   • Title: Chat acceptances.
   • Chart type: Aggregate by property.
   • Blueprint: github_copilot_usage.
   • Property: total_chat_acceptances.
   • Function: Average.
   • Measure time by: createdAt.

7. Click Save.

Total suggestions vs. acceptances over time widget

Total suggestions vs. acceptances over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Title: Total Suggestions vs. Acceptances Over Time. Description: How Copilot suggestions and acceptances change over time to track usage and engagement. Icon: LineChart.

3. Set X axis:

   • Title: Date.
   • Time interval: Week.
   • Time range: In the past 30 days.

4. Set Y axis title: Count.

5. Click + Line and configure:

   • Title: Total suggestions.
   • Chart type: Aggregate by property.
   • Blueprint: github_copilot_usage.
   • Property: total_suggestions_count.
   • Function: Average.
   • Measure time by: createdAt.

6. Click + Line and configure:

   • Title: Total acceptances.
   • Chart type: Aggregate by property.
   • Blueprint: github_copilot_usage.
   • Property: total_acceptances_count.
   • Function: Average.
   • Measure time by: createdAt.

7. Click Save.

GitHub (Ocean)

Total active users widget

Total active users (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Total Active Users (Avg).
   • Description: Average number of active users using Copilot per day.
   • Icon: Users.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate by property.
   • Property: daily_active_users.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: users.

3. Click Save.

Overall acceptance rate widget

Overall acceptance rate (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Overall Acceptance Rate (%).
   • Description: How often Copilot suggestions are accepted.
   • Icon: metric.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate by property.
   • Property: acceptance_rate.
   • Function: Average.
   • Average of: total.
   • Unit: %.

3. Click Save.

Total suggestions generated widget

Total suggestions generated (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: Total Suggestions Generated.
   • Description: Average suggested lines of code per day.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate by property.
   • Property: loc_suggested_to_add_sum.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: suggested lines of code.

3. Click Save.

User-initiated interactions widget

User-initiated interactions (click to expand)

1. Click on + Widget and select Number Chart.

2. Fill in the following details:

   • Title: User-Initiated Interactions.
   • Description: Average user-initiated interactions per day.
   • Icon: Chat.
   • Blueprint: githubCopilotOrganizationUsage.
   • Chart type: Select Aggregate by property.
   • Property: user_initiated_interaction_count.
   • Function: Average.
   • Average of: day.
   • Measure time by: createdAt.
   • Custom unit: interactions.

3. Click Save.

Usage by organization widget

Usage by organization (click to expand)

1. Click on + Widget and select Pie Chart.

2. Fill in the following details:

   • Title: Usage by Organization.
   • Description: Contribution of each organization to copilot usage.
   • Icon: Pie.
   • Blueprint: githubCopilotOrganizationUsage.
   • Breakdown by Property: git_hub_org.

3. Click Save.

Acceptance rate over time widget

Acceptance rate over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Title: Acceptance Rate Over Time. Description: See quality improvements (or declines) over time. Icon: LineChart.

3. Set X axis:

   • Title: Date.
   • Time interval: Week.
   • Time range: In the past 30 days.

4. Set Y axis title: Acceptances.

5. Click + Line and configure:

   • Title: Code acceptance activity.
   • Chart type: Aggregate by property.
   • Blueprint: githubCopilotOrganizationUsage.
   • Property: code_acceptance_activity_count.
   • Function: Average.
   • Measure time by: createdAt.

6. Click Save.

Active users over time widget

Active users over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Title: Active Users Over Time. Description: Shows if organization usage is growing. Icon: LineChart.

3. Set X axis:

   • Title: Date.
   • Time interval: Week.
   • Time range: In the past 30 days.

4. Set Y axis title: Users.

5. Click + Line and configure:

   • Title: Daily active users.
   • Chart type: Aggregate by property.
   • Blueprint: githubCopilotOrganizationUsage.
   • Property: daily_active_users.
   • Function: Average.
   • Measure time by: createdAt.

6. Click Save.

User-initiated interactions over time widget

User-initiated interactions over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Title: User-Initiated Interactions Over Time. Description: Reveals growing reliance on Copilot interactions. Icon: LineChart.

3. Set X axis:

   • Title: Date.
   • Time interval: Week.
   • Time range: In the past 30 days.

4. Set Y axis title: Interactions.

5. Click + Line and configure:

   • Title: User-initiated interactions.
   • Chart type: Aggregate by property.
   • Blueprint: githubCopilotOrganizationUsage.
   • Property: user_initiated_interaction_count.
   • Function: Average.
   • Measure time by: createdAt.

6. Click Save.

Total suggestions vs. acceptances over time widget

Total suggestions vs. acceptances over time (click to expand)

1. Click on + Widget and select Line Chart.

2. Title: Total Suggestions vs. Acceptances Over Time. Description: How Copilot suggestions and acceptances change over time to track usage and engagement. Icon: LineChart.

3. Set X axis:

   • Title: Date.
   • Time interval: Week.
   • Time range: In the past 30 days.

4. Set Y axis title: Count.

5. Click + Line and configure:

   • Title: Code generation activity.
   • Chart type: Aggregate by property.
   • Blueprint: githubCopilotOrganizationUsage.
   • Property: code_generation_activity_count.
   • Function: Average.
   • Measure time by: createdAt.

6. Click + Line and configure:

   • Title: Code acceptance activity.
   • Chart type: Aggregate by property.
   • Blueprint: githubCopilotOrganizationUsage.
   • Property: code_acceptance_activity_count.
   • Function: Average.
   • Measure time by: createdAt.

7. Click Save.