Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parsing local and cloud SEG-Y files with new I/O library #381

Merged
merged 67 commits into from
Jun 25, 2024
Merged

Commits on Jun 19, 2024

  1. Refactor text_header setter type check

    Removed the list type check from the text_header setter in accessor.py. The application now expects a string input instead of a list, simplifying the validation process.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    d4b1bfe View commit details
    Browse the repository at this point in the history
  2. Refactor text_header setter type check

    Removed the list type check from the text_header setter in accessor.py. The application now expects a string input instead of a list, simplifying the validation process.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    fc30345 View commit details
    Browse the repository at this point in the history
  3. Refactor text_header setter type check

    Removed the list type check from the text_header setter in accessor.py. The application now expects a string input instead of a list, simplifying the validation process.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    a13a87b View commit details
    Browse the repository at this point in the history
  4. Refactor workers for SEG-Y parsing

    Simplify `header_scan_worker` and `trace_worker` in SEG-Y module by removing unused imports and streamlining parameter list. Update functions to work directly with `SegyFile` instances and clean up data handling logic for efficiency.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    accc92c View commit details
    Browse the repository at this point in the history
  5. Refactor SEG-Y parser and streamline imports

    Refactor the parsing functions in `src/mdio/segy/parsers.py` to simplify the codebase and improve maintainability. Redundant functions such as `parse_binary_header`, `parse_text_header`, and `get_trace_count` have been removed, while imports have been condensed to only essential modules. The `NUM_CORES` logic is updated to count logical cores instead of just physical ones.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    1ddd5df View commit details
    Browse the repository at this point in the history
  6. Refactor SEG-Y converter and simplify imports

    Removed unused imports and functions in the SEG-Y converter module to enhance code maintainability. Simplified the arguments for the `segy_to_mdio` function to increase ease of use and readability. Reduced complexity by utilizing `SegyFile` class for SEG-Y file operations.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    1f83b62 View commit details
    Browse the repository at this point in the history
  7. Refactor get_grid_plan and remove unused imports

    The get_grid_plan function in utilities.py has been refactored to accept a SegyFile instance instead of individual parameters for the file path. Unused imports were eliminated, and type checking imports are now conditional, improving readability and modularity.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    043d645 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    c3ebd05 View commit details
    Browse the repository at this point in the history
  9. Refactor to use 'segy' instead of 'segyio'.

    The changes involve major refactoring of the code base to use the 'segy' library instead of 'segyio'. Most notably, this included updating the handling of SEG-Y dtypes, byte order, and trace headers. Unused imports have been removed to clean up the code. A new multiprocessing chunk size has been introduced and set attributes to SegyFile instance instead of passing them as function arguments.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    093eab9 View commit details
    Browse the repository at this point in the history
  10. refactor override tests to use ndarray headers instead of a dictionar…

    …y to make it work with 'segy'.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    9c4d169 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    77f660b View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    80a882d View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    d986247 View commit details
    Browse the repository at this point in the history
  14. Upgrade segy package version

    The segy package version has been updated from 0.0.13 to 0.0.14 in the pyproject.toml file. This upgrade was performed to update software dependencies and to integrate the latest bug fixes and features delivered with the new version.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    7771c9e View commit details
    Browse the repository at this point in the history
  15. Refactored segy factory creation in mdio_to_segy function

    A new helper function, 'make_segy_factory', has been created to handle the generation of SegyFactory. This function accepts more parameters to provide better control over the creation of the SEG-Y based on the MDIO metadata. Changes also include updates in import declarations and reorganization of some code blocks in the 'mdio_spec_to_segy' function.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    6cb196a View commit details
    Browse the repository at this point in the history
  16. Update segy library version

    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    b4e6154 View commit details
    Browse the repository at this point in the history
  17. Multiply sample_interval by 1000 in SegyFactory

    In the SegyFactory initialization within creation.py, the sample_interval parameter has been modified to be multiplied by 1000. This change ensures that the value is correctly represented in microseconds, aligning with the expected data format.
    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    a7cc54c View commit details
    Browse the repository at this point in the history
  18. fix docstring errors

    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    2be0429 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    4eaa1ce View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    11b5463 View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    f3ecf85 View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    91f7e58 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    ddceae7 View commit details
    Browse the repository at this point in the history
  24. update binary header

    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    0924cb0 View commit details
    Browse the repository at this point in the history
  25. Configuration menu
    Copy the full SHA
    301b879 View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    011d565 View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    ed0894d View commit details
    Browse the repository at this point in the history
  28. update RtD dependencies

    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    745eaab View commit details
    Browse the repository at this point in the history
  29. switch myst-nb to stable

    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    1b532df View commit details
    Browse the repository at this point in the history
  30. fix broken tests

    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    116fe9b View commit details
    Browse the repository at this point in the history
  31. fix broken tests

    tasansal committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    99fad15 View commit details
    Browse the repository at this point in the history
  32. Configuration menu
    Copy the full SHA
    cd99d18 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Configuration menu
    Copy the full SHA
    20ff242 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Configuration menu
    Copy the full SHA
    d785eda View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    2f5d3a1 View commit details
    Browse the repository at this point in the history
  3. streamline mdio segy spec

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    44a3cdf View commit details
    Browse the repository at this point in the history
  4. simplify mock 4d generation

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    0f47801 View commit details
    Browse the repository at this point in the history
  5. enforce mdio segy spec

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    de7a39c View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    becbda9 View commit details
    Browse the repository at this point in the history
  7. revert api

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    2898163 View commit details
    Browse the repository at this point in the history
  8. update type hints

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    0fb5190 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    710f2e4 View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    ec6103d View commit details
    Browse the repository at this point in the history
  11. update endian kwarg name

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    502968c View commit details
    Browse the repository at this point in the history
  12. revert to old api

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    598b3a4 View commit details
    Browse the repository at this point in the history
  13. enable all tests

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    02509de View commit details
    Browse the repository at this point in the history
  14. Update get_grid_plan

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    07ebaa4 View commit details
    Browse the repository at this point in the history
  15. Configuration menu
    Copy the full SHA
    0b3f81a View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    abca82e View commit details
    Browse the repository at this point in the history
  17. Add temporary safety check ignore for specific CVE

    The safety check in noxfile.py has been updated to temporarily ignore a specific Common Vulnerabilities and Exposures (CVE) number because it's not deemed critical. A TODO note is added to remind removal of this exception once the issue is resolved.
    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    b5a6d33 View commit details
    Browse the repository at this point in the history
  18. fix safety ignore syntax

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    914b196 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    ecfc5a6 View commit details
    Browse the repository at this point in the history
  20. revert to_segy endian api

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    e3bb976 View commit details
    Browse the repository at this point in the history
  21. simplify changes

    tasansal committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    212aaab View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Configuration menu
    Copy the full SHA
    ad2e557 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b6a52c1 View commit details
    Browse the repository at this point in the history
  3. use correct spec for factory

    tasansal committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    5a2e92f View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    9d49bc8 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    b209e4e View commit details
    Browse the repository at this point in the history
  6. remove unnecessary cast

    tasansal committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    e8c1053 View commit details
    Browse the repository at this point in the history
  7. remove commented line

    tasansal committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    4e8f028 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    e26d1e7 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    1eb1e96 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Configuration menu
    Copy the full SHA
    bb8084b View commit details
    Browse the repository at this point in the history
  2. bump version

    tasansal committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    ae9f731 View commit details
    Browse the repository at this point in the history
  3. add missing return doc

    tasansal committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    e173a7f View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b078644 View commit details
    Browse the repository at this point in the history