🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 87 (from laksa046)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa087.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.sec.gov/edgar/search/\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.sec.gov/edgar/search/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.sec.gov\/edgar\/search\/","crawl_time":1776710199,"first_indexed_time":1593445870,"http_code":200,"src_unparsed":"gov,sec!www,\/edgar\/search\/ s443","src_root_hash":"14764745728794394287","history_drop_reason":null,"meta_title":"SEC.gov | EDGAR Full Text Search","meta_descriptions":[],"attrs_boilerpipe_text":"Document word or phrase\nCompany name, ticker, CIK number or individual's name\n+ more search options\nFiling category\nBrowse filing types\nFiling types\nBrowse filing types","attrs_markdown":"- [![](https:\/\/www.sec.gov\/edgar\/search\/images\/edgar-logo-2x.png)](https:\/\/www.sec.gov\/)\n- [SEC.gov](https:\/\/www.sec.gov\/)\n- [EDGAR](https:\/\/www.sec.gov\/edgar\/search\/)\n\n- [FAQ](https:\/\/www.sec.gov\/edgar\/search\/efts-faq.html)\n- [Other search tools](https:\/\/www.sec.gov\/edgar\/search-and-access)\n## The new EDGAR advanced search gives you access to the full text of electronic filings since 2001.\n\n####\n#### Refine search results by:\n[Entity](https:\/\/www.sec.gov\/edgar\/search\/#collapseOne1)\n\n[Form](https:\/\/www.sec.gov\/edgar\/search\/#collapseTwo2)\n\n[Incorporated in](https:\/\/www.sec.gov\/edgar\/search\/#collapseThree3)\n\n[Principal executive offices located in](https:\/\/www.sec.gov\/edgar\/search\/#collapseFour4)\n\n*Click headings to show top filters.  Document counts shown in \\#*\n\n#####\n###### Show Columns\nFiled\n\nReporting for\n\nCIK\n\nLocated\n\nIncorporated\n\nFile number\n\nFilm number\n\n| Form & File | Filed | Reporting for | Filing entity\/person | CIK | Located | Incorporated | File number | Film number |\n|---|---|---|---|---|---|---|---|---|\n\n- [Previous page](https:\/\/www.sec.gov\/edgar\/search\/)\n- [1](https:\/\/www.sec.gov\/edgar\/search\/)\n- [2](https:\/\/www.sec.gov\/edgar\/search\/)\n- [3](https:\/\/www.sec.gov\/edgar\/search\/)\n- [4](https:\/\/www.sec.gov\/edgar\/search\/)\n- [5](https:\/\/www.sec.gov\/edgar\/search\/)\n- [6](https:\/\/www.sec.gov\/edgar\/search\/)\n- [7](https:\/\/www.sec.gov\/edgar\/search\/)\n- [8](https:\/\/www.sec.gov\/edgar\/search\/)\n- [9](https:\/\/www.sec.gov\/edgar\/search\/)\n- [10](https:\/\/www.sec.gov\/edgar\/search\/)\n- [Next page](https:\/\/www.sec.gov\/edgar\/search\/)\n\n- [Accessibility](https:\/\/www.sec.gov\/disability\/sec_access.htm)\n- [Budget & Performance](https:\/\/www.sec.gov\/about\/offices\/ofm\/ofm-documents.htm)\n- [Careers](https:\/\/www.sec.gov\/careers)\n- [Contact](https:\/\/www.sec.gov\/contact-information\/sec-directory)\n- [Contracts](https:\/\/www.sec.gov\/page\/oacqsectionlanding)\n- [Data](https:\/\/www.sec.gov\/sec-data-resources)\n- [FOIA](https:\/\/www.sec.gov\/page\/office-foia-services)\n- [Inspector General](https:\/\/www.sec.gov\/oig)\n- [Investor.gov](https:\/\/www.investor.gov\/)\n- [No FEAR Act & EEO Data](https:\/\/www.sec.gov\/page\/eeosectionlanding)\n- [Ombudsman](https:\/\/www.sec.gov\/ombudsman)\n- [Plain Writing](https:\/\/www.sec.gov\/plainwriting.shtml)\n- [Privacy](https:\/\/www.sec.gov\/privacy.htm)\n- [Related Sites](https:\/\/www.sec.gov\/links)\n- [Site Map](https:\/\/www.sec.gov\/sitemap.shtml)\n- [USA.gov](https:\/\/www.usa.gov\/)\n- [Votes](https:\/\/www.sec.gov\/about\/commission-votes.shtml)\n- [Vulnerability Disclosure Policy](https:\/\/www.sec.gov\/vulnerability-disclosure-policy \"Vulnerability Disclosure Policy\")\n- [Whistleblower Protection](https:\/\/www.sec.gov\/whistleblower)\n\n#### Finding **users keywords** in filename.html ‹ Previous 1 of 1x2 Next ›\n×\n\n[Open document]()\n\n[Open filing]()\n\nClose\n\nCheck forms that you want to search. Use the category select to narrow the choices.\n\nView all\n\n×\n\ncheck\/uncheck all forms\n\nFilter\n\nCancel","attrs_readable_markdown":"Document word or phrase\n\nCompany name, ticker, CIK number or individual's name   [\\+ more search options](https:\/\/www.sec.gov\/edgar\/search\/)\n\nFiling category Browse filing types\n\nFiling typesBrowse filing types","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

14 hours ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.sec.gov/edgar/search/
Last Crawled	2026-04-20 18:36:39 (14 hours ago)
First Indexed	2020-06-29 15:51:10 (5 years ago)
HTTP Status Code	200
Meta Title	SEC.gov \| EDGAR Full Text Search
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Document word or phrase Company name, ticker, CIK number or individual's name + more search options Filing category Browse filing types Filing types Browse filing types
Markdown	- [![](https://www.sec.gov/edgar/search/images/edgar-logo-2x.png)](https://www.sec.gov/) - [SEC.gov](https://www.sec.gov/) - [EDGAR](https://www.sec.gov/edgar/search/) - [FAQ](https://www.sec.gov/edgar/search/efts-faq.html) - [Other search tools](https://www.sec.gov/edgar/search-and-access) ## The new EDGAR advanced search gives you access to the full text of electronic filings since 2001. #### #### Refine search results by: [Entity](https://www.sec.gov/edgar/search/#collapseOne1) [Form](https://www.sec.gov/edgar/search/#collapseTwo2) [Incorporated in](https://www.sec.gov/edgar/search/#collapseThree3) [Principal executive offices located in](https://www.sec.gov/edgar/search/#collapseFour4) Click headings to show top filters. Document counts shown in \# ##### ###### Show Columns Filed Reporting for CIK Located Incorporated File number Film number \| Form & File \| Filed \| Reporting for \| Filing entity/person \| CIK \| Located \| Incorporated \| File number \| Film number \| \|---\|---\|---\|---\|---\|---\|---\|---\|---\| - [Previous page](https://www.sec.gov/edgar/search/) - [1](https://www.sec.gov/edgar/search/) - [2](https://www.sec.gov/edgar/search/) - [3](https://www.sec.gov/edgar/search/) - [4](https://www.sec.gov/edgar/search/) - [5](https://www.sec.gov/edgar/search/) - [6](https://www.sec.gov/edgar/search/) - [7](https://www.sec.gov/edgar/search/) - [8](https://www.sec.gov/edgar/search/) - [9](https://www.sec.gov/edgar/search/) - [10](https://www.sec.gov/edgar/search/) - [Next page](https://www.sec.gov/edgar/search/) - [Accessibility](https://www.sec.gov/disability/sec_access.htm) - [Budget & Performance](https://www.sec.gov/about/offices/ofm/ofm-documents.htm) - [Careers](https://www.sec.gov/careers) - [Contact](https://www.sec.gov/contact-information/sec-directory) - [Contracts](https://www.sec.gov/page/oacqsectionlanding) - [Data](https://www.sec.gov/sec-data-resources) - [FOIA](https://www.sec.gov/page/office-foia-services) - [Inspector General](https://www.sec.gov/oig) - [Investor.gov](https://www.investor.gov/) - [No FEAR Act & EEO Data](https://www.sec.gov/page/eeosectionlanding) - [Ombudsman](https://www.sec.gov/ombudsman) - [Plain Writing](https://www.sec.gov/plainwriting.shtml) - [Privacy](https://www.sec.gov/privacy.htm) - [Related Sites](https://www.sec.gov/links) - [Site Map](https://www.sec.gov/sitemap.shtml) - [USA.gov](https://www.usa.gov/) - [Votes](https://www.sec.gov/about/commission-votes.shtml) - [Vulnerability Disclosure Policy](https://www.sec.gov/vulnerability-disclosure-policy "Vulnerability Disclosure Policy") - [Whistleblower Protection](https://www.sec.gov/whistleblower) #### Finding users keywords in filename.html ‹ Previous 1 of 1x2 Next › × [Open document]() [Open filing]() Close Check forms that you want to search. Use the category select to narrow the choices. View all × check/uncheck all forms Filter Cancel
Readable Markdown	Document word or phrase Company name, ticker, CIK number or individual's name [\+ more search options](https://www.sec.gov/edgar/search/) Filing category Browse filing types Filing typesBrowse filing types
Shard	87 (laksa)
Root Hash	14764745728794394287
Unparsed URL	gov,sec!www,/edgar/search/ s443