Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add repo sync analytics #1122

Merged
merged 4 commits into from
Nov 15, 2023
Merged

add repo sync analytics #1122

merged 4 commits into from
Nov 15, 2023

Commits on Nov 9, 2023

  1. add repo sync analytics

    tracks repo metadata on first index, or on full reindex (when the
    tantivy index hash is updated, for example), includes the following
    info:
    
    - repo ref
    - repo provider
    - size in bytes
    - number of qdrant chunks
    - time taken to index
    
    sample event:
    
        RepoEvent {
            name: "index",
            payload: [
                ("repo_ref", String("nerdypepper/dijo")),
                ("provider", String("github")),
                ("file_count", Number(35)),
                ("chunk_count", Number(236)),
                ("bytes", String("116.59KB")),
                ("sync_time", String("4.957807429s")),
            ],
        }
    
    ---
    
    to test this changeset, set the following values in `local_config.json`:
    
        {
            "analytics_key": "..",
            "analytics_data_plane": ".."
        }
    
    run rudderstack in "live event stream" mode, and index a repository.
    oppiliappan committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    9221d32 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. track reindexs

    - marks full index resets as `SchemaUpgrade`s
    - marks periodic reindex jobs as `PeriodicSync`s
    oppiliappan committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    c3e5ac8 View commit details
    Browse the repository at this point in the history
  2. clippy

    oppiliappan committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    146a864 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. address review comments

    oppiliappan committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    65b2190 View commit details
    Browse the repository at this point in the history