Major rewrite to make things more consistent and extensible

.github/workflows/file-issue-for-review.yml

@@ -26,12 +26,15 @@ jobs:
  run: |
  git config user.name "strudy-bot"
  git config user.email "<>"
- git remote set-url --push origin https://x-access-token:${{ secrets.GITHUB_TOKEN }}@github.com/$GITHUB_REPOSITORY
+ git remote set-url --push origin https://x-access-token:${{ secrets.ISSUE_REPORT_GH_TOKEN }}@github.com/$GITHUB_REPOSITORY
  working-directory: strudy
+ - name: Run Strudy to detect new anomalies
+ working-directory: strudy
+ run: node strudy.js inspect ../webref --issues issues --what brokenLinks discontinuedReferences --update-mode old
  - name: Run issue filer script
  working-directory: strudy
- run: node src/reporting/file-issue-for-review.js ../webref/ed/ ../webref/tr/ brokenLinks
+ run: node src/reporting/file-issue-for-review.js --max 10
  env:
- GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
+ GITHUB_TOKEN: ${{ secrets.ISSUE_REPORT_GH_TOKEN }}
 
 

index.js

@@ -1,8 +1,6 @@
-import studyCrawl from './src/lib/study-crawl.js';
-import studyWebIdl from './src/lib/study-webidl.js';
-import generateReport from './src/lib/generate-report.js';
+import study from './src/lib/study.js';
 
-export { studyCrawl, studyWebIdl, generateReport };
+export { study };
 
-const strudy = { studyCrawl, studyWebIdl, generateReport };
+const strudy = { study };
 export default strudy;

issues/DOM-Parsing-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/DOM-Parsing/issues/74'
 Title: Broken references in DOM Parsing and Serialization
 ---
 
-While crawling [DOM Parsing and Serialization](https://w3c.github.io/DOM-Parsing/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [DOM Parsing and Serialization](https://w3c.github.io/DOM-Parsing/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://www.w3.org/TR/dom/#case-sensitive
 * [ ] https://www.w3.org/TR/dom/#ascii-case-insensitive
 * [ ] https://www.w3.org/TR/dom/#domexception

issues/FileAPI-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/FileAPI/issues/185'
 Title: Broken references in File API
 ---
 
-While crawling [File API](https://w3c.github.io/FileAPI/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [File API](https://w3c.github.io/FileAPI/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://mimesniff.spec.whatwg.org/#parsable-mime-type
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/background-fetch-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/background-fetch/issues/167'
 Title: Broken references in Background Fetch
 ---
 
-While crawling [Background Fetch](https://wicg.github.io/background-fetch/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Background Fetch](https://wicg.github.io/background-fetch/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://fetch.spec.whatwg.org/#concept-fetch-terminate
 * [ ] https://w3c.github.io/permissions/#permission-state
 * [ ] https://w3c.github.io/permissions/#dictdef-permissiondescriptor

issues/background-sync-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/background-sync/issues/186'
 Title: Broken references in Web Background Synchronization
 ---
 
-While crawling [Web Background Synchronization](https://wicg.github.io/background-sync/spec/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Web Background Synchronization](https://wicg.github.io/background-sync/spec/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://notifications.spec.whatwg.org/#permission-model
 * [ ] https://slightlyoff.github.io/ServiceWorker/spec/service_worker/index.html#service-worker-registration-interface
 * [ ] https://slightlyoff.github.io/ServiceWorker/spec/service_worker/index.html#service-worker-global-scope-interface

issues/change-password-url-discontinuedreferences.md

@@ -6,7 +6,7 @@ Title: >-
  Passwords
 ---
 
-While crawling [A Well-Known URL for Changing Passwords](https://w3c.github.io/webappsec-change-password-url/), the following normative referenced were detected as pointing to discontinued specifications:
+While crawling [A Well-Known URL for Changing Passwords](https://w3c.github.io/webappsec-change-password-url/), the following normative references were detected as pointing to discontinued specifications:
 * [ ] [HTTP-SEMANTICS](https://httpwg.org/specs/rfc7231.html) has been obsoleted by [rfc9110](https://httpwg.org/specs/rfc9110.html)
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/clear-site-data-discontinuedreferences.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/webappsec-clear-site-data/issues/79'
 Title: Normative references to discontinued specs in Clear Site Data
 ---
 
-While crawling [Clear Site Data](https://w3c.github.io/webappsec-clear-site-data/), the following normative referenced were detected as pointing to discontinued specifications:
+While crawling [Clear Site Data](https://w3c.github.io/webappsec-clear-site-data/), the following normative references were detected as pointing to discontinued specifications:
 * [ ] [RFC7230](https://httpwg.org/specs/rfc7230.html) has been obsoleted by [rfc9110](https://httpwg.org/specs/rfc9110.html),[rfc9112](https://httpwg.org/specs/rfc9112.html)
 * [ ] [RFC7234](https://httpwg.org/specs/rfc7234.html) has been obsoleted by [rfc9111](https://httpwg.org/specs/rfc9111.html)
 

issues/clipboard-apis-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/clipboard-apis/issues/187'
 Title: Broken references in Clipboard API and events
 ---
 
-While crawling [Clipboard API and events](https://w3c.github.io/clipboard-apis/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Clipboard API and events](https://w3c.github.io/clipboard-apis/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://html.spec.whatwg.org/multipage/interaction.html#drag-data-item-kind
 * [ ] https://html.spec.whatwg.org/multipage/interaction.html#drag-data-item-type-string
 

issues/content-index-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/content-index/issues/33'
 Title: Broken references in Content Index
 ---
 
-While crawling [Content Index](https://wicg.github.io/content-index/spec/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Content Index](https://wicg.github.io/content-index/spec/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://dom.spec.whatwg.org/#context-object
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/csp-embedded-enforcement-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/webappsec-cspee/issues/27'
 Title: 'Broken references in Content Security Policy: Embedded Enforcement'
 ---
 
-While crawling [Content Security Policy: Embedded Enforcement](https://w3c.github.io/webappsec-cspee/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Content Security Policy: Embedded Enforcement](https://w3c.github.io/webappsec-cspee/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://fetch.spec.whatwg.org/#concept-response-csp-list
 * [ ] https://w3c.github.io/webappsec-csp/#port-part-match
 

issues/css-line-grid-1-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/csswg-drafts/issues/8080'
 Title: '[css-line-grid] Broken references in CSS Line Grid Module Level 1'
 ---
 
-While crawling [CSS Line Grid Module Level 1](https://drafts.csswg.org/css-line-grid/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [CSS Line Grid Module Level 1](https://drafts.csswg.org/css-line-grid/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://drafts.csswg.org/css-inline/#central
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/css-nav-1-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/csswg-drafts/issues/8081'
 Title: '[css-nav-1] Broken references in CSS Spatial Navigation Level 1'
 ---
 
-While crawling [CSS Spatial Navigation Level 1](https://drafts.csswg.org/css-nav-1/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [CSS Spatial Navigation Level 1](https://drafts.csswg.org/css-nav-1/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://drafts.csswg.org/css2/box.html#x14
 * [ ] https://html.spec.whatwg.org/multipage/infrastructure.html#nodes-are-removed
 * [ ] https://html.spec.whatwg.org/multipage/interaction.html#expressly-inert

issues/filter-effects-1-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/fxtf-drafts/issues/482'
 Title: '[filter-effects-1] Broken references in Filter Effects Module Level 1'
 ---
 
-While crawling [Filter Effects Module Level 1](https://drafts.fxtf.org/filter-effects-1/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Filter Effects Module Level 1](https://drafts.fxtf.org/filter-effects-1/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://drafts.csswg.org/css-transitions/#animtype-length
 * [ ] https://drafts.csswg.org/css-transitions/#animtype-number
 * [ ] https://drafts.csswg.org/css-transitions/#animtype-shadow-list

issues/get-installed-related-apps-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/get-installed-related-apps/issues/35'
 Title: Broken references in Get Installed Related Apps API
 ---
 
-While crawling [Get Installed Related Apps API](https://wicg.github.io/get-installed-related-apps/spec/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Get Installed Related Apps API](https://wicg.github.io/get-installed-related-apps/spec/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://dom.spec.whatwg.org/#context-object
 * [ ] https://www.w3.org/TR/appmanifest/#dom-fingerprint
 * [ ] https://www.w3.org/TR/appmanifest/#dom-externalapplicationresource

issues/html-aam-1.0-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/html-aam/issues/447'
 Title: Broken references in HTML Accessibility API Mappings 1.0
 ---
 
-While crawling [HTML Accessibility API Mappings 1.0](https://w3c.github.io/html-aam/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [HTML Accessibility API Mappings 1.0](https://w3c.github.io/html-aam/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://html.spec.whatwg.org/multipage/iframe-embed-object.html#attr-param-name
 * [ ] https://html.spec.whatwg.org/multipage/microdata.html#attr-itemprop
 * [ ] https://html.spec.whatwg.org/multipage/sections.html#sectioning-root

issues/html-discontinuedreferences.md

@@ -4,7 +4,7 @@ Tracked: 'https:/whatwg/html/issues/9981'
 Title: Normative references to discontinued specs in HTML Standard
 ---
 
-While crawling [HTML Standard](https://html.spec.whatwg.org/multipage/), the following normative referenced were detected as pointing to discontinued specifications:
+While crawling [HTML Standard](https://html.spec.whatwg.org/multipage/), the following normative references were detected as pointing to discontinued specifications:
 * [ ] [HTTP](https://httpwg.org/specs/rfc7230.html) has been obsoleted by [rfc9110](https://httpwg.org/specs/rfc9110.html),[rfc9112](https://httpwg.org/specs/rfc9112.html)
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/intersection-observer-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/IntersectionObserver/issues/506'
 Title: Broken references in Intersection Observer
 ---
 
-While crawling [Intersection Observer](https://w3c.github.io/IntersectionObserver/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Intersection Observer](https://w3c.github.io/IntersectionObserver/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] http://www.w3.org/TR/hr-time/#domhighrestimestamp
 * [ ] http://www.w3.org/TR/hr-time/#time-origin
 * [ ] https://drafts.csswg.org/css-box/#containing-block

issues/json-ld11-discontinuedreferences.md

@@ -4,7 +4,7 @@ Tracked: 'https:/w3c/json-ld-syntax/issues/423'
 Title: Normative references to discontinued specs in JSON-LD 1.1
 ---
 
-While crawling [JSON-LD 1.1](https://w3c.github.io/json-ld-syntax/), the following normative referenced were detected as pointing to discontinued specifications:
+While crawling [JSON-LD 1.1](https://w3c.github.io/json-ld-syntax/), the following normative references were detected as pointing to discontinued specifications:
 * [ ] [RFC7231](https://tools.ietf.org/html/rfc7231) has been obsoleted by [rfc9110](https://httpwg.org/specs/rfc9110.html)
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/keyboard-lock-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/keyboard-lock/issues/68'
 Title: Broken references in Keyboard Lock
 ---
 
-While crawling [Keyboard Lock](https://wicg.github.io/keyboard-lock/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Keyboard Lock](https://wicg.github.io/keyboard-lock/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] http://www.w3.org/TR/uievents-code/#code-keyw
 * [ ] http://www.w3.org/TR/uievents-code/#code-keya
 * [ ] http://www.w3.org/TR/uievents-code/#code-keys

issues/keyboard-map-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/keyboard-map/issues/43'
 Title: Broken references in Keyboard Map
 ---
 
-While crawling [Keyboard Map](https://wicg.github.io/keyboard-map/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Keyboard Map](https://wicg.github.io/keyboard-map/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] http://www.w3.org/TR/uievents-code/#code-quote
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/layout-instability-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/layout-instability/issues/116'
 Title: Broken references in Layout Instability API
 ---
 
-While crawling [Layout Instability API](https://wicg.github.io/layout-instability/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Layout Instability API](https://wicg.github.io/layout-instability/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://w3c.github.io/resource-timing/#sec-privacy-security
 * [ ] https://www.w3.org/TR/css-values-4/#pixel-unit
 

issues/media-feeds-discontinuedreferences.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/media-feeds/issues/60'
 Title: Normative references to discontinued specs in Media Feeds
 ---
 
-While crawling [Media Feeds](https://wicg.github.io/media-feeds/), the following normative referenced were detected as pointing to discontinued specifications:
+While crawling [Media Feeds](https://wicg.github.io/media-feeds/), the following normative references were detected as pointing to discontinued specifications:
 * [ ] [rfc7231](https://httpwg.org/specs/rfc7231.html) has been obsoleted by [rfc9110](https://httpwg.org/specs/rfc9110.html)
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/nav-tracking-mitigations-discontinuedreferences.md

@@ -6,7 +6,7 @@ Title: >-
  Mitigations
 ---
 
-While crawling [Navigational-Tracking Mitigations](https://privacycg.github.io/nav-tracking-mitigations/), the following normative referenced were detected as pointing to discontinued specifications:
+While crawling [Navigational-Tracking Mitigations](https://privacycg.github.io/nav-tracking-mitigations/), the following normative references were detected as pointing to discontinued specifications:
 * [ ] [RFC7234](https://httpwg.org/specs/rfc7234.html) has been obsoleted by [rfc9111](https://httpwg.org/specs/rfc9111.html)
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/netinfo-discontinuedreferences.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/netinfo/issues/97'
 Title: Normative references to discontinued specs in Network Information API
 ---
 
-While crawling [Network Information API](https://wicg.github.io/netinfo/), the following normative referenced were detected as pointing to discontinued specifications:
+While crawling [Network Information API](https://wicg.github.io/netinfo/), the following normative references were detected as pointing to discontinued specifications:
 * [ ] [RFC7231](https://httpwg.org/specs/rfc7231.html) has been obsoleted by [rfc9110](https://httpwg.org/specs/rfc9110.html)
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>

issues/periodic-background-sync-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/periodic-background-sync/issues/11'
 Title: Broken references in Web Periodic Background Synchronization
 ---
 
-While crawling [Web Periodic Background Synchronization](https://wicg.github.io/periodic-background-sync/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Web Periodic Background Synchronization](https://wicg.github.io/periodic-background-sync/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://dom.spec.whatwg.org/#context-object
 * [ ] https://w3c.github.io/permissions/#enumdef-permissionstate
 * [ ] https://w3c.github.io/permissions/#dictdef-permissiondescriptor

issues/permissions-request-brokenlinks.md

@@ -4,7 +4,7 @@ Tracked: 'https:/WICG/permissions-request/issues/8'
 Title: Broken references in Requesting Permissions
 ---
 
-While crawling [Requesting Permissions](https://wicg.github.io/permissions-request/), the following links to other specifications were detected as pointing to non-existing anchors, which should be fixed:
+While crawling [Requesting Permissions](https://wicg.github.io/permissions-request/), the following links to other specifications were detected as pointing to non-existing anchors:
 * [ ] https://w3c.github.io/permissions/#permission-registry
 
 <sub>This issue was detected and reported semi-automatically by [Strudy](https:/w3c/strudy/) based on data collected in [webref](https:/w3c/webref/).</sub>