🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 17 (from laksa129)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa017.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.oag.state.va.us/consumer-protection/\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.oag.state.va.us/consumer-protection/\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.oag.state.va.us\/consumer-protection\/","crawl_time":1775778412,"first_indexed_time":1505563498,"http_code":200,"src_unparsed":"us,va,state!oag,www,\/consumer-protection\/ s443","src_root_hash":"15077382450256512217","history_drop_reason":null,"meta_title":"Home","meta_descriptions":[],"attrs_boilerpipe_text":"Jay Jones\nAttorney General of Virginia\nOAG Main\nHome\nFile a Complaint\nBack\nAgency Search\nComplaint Database\nScams\nBack\nScam Alerts Archive\nTips & Info\nLaws & Cases\nBack\nLawsuits & Settlements\nNews\nBack\nConsumer Protection Quarterly Newsletter\nPublications\nBack\nOther Agency Publications\nContact Us\nBack\nContact Us\nConsumer Protection\nFiling a Complaint\nSearch Our\nComplaint Database\nConsumer Protection\nSubscribe\nVirginia Consumer\nLaws & Cases\nScams\nRecent News\nAbout Us","attrs_markdown":"# Jay Jones  Attorney General of Virginia\n- [OAG Main](https:\/\/www.oag.state.va.us\/)\n- [Home](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php)\n- [File a Complaint](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/file-a-complaint)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Agency Search](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/file-a-complaint\/agency-search)\n- [Complaint Database](https:\/\/www.oag.state.va.us\/consumer-protection\/complaint\/search)\n- [Scams](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/scams-information)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Scam Alerts Archive](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/scams-information\/scam-alerts-archive)\n- [Tips & Info](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/tips-info2)\n- [Laws & Cases](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/laws-cases)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Lawsuits & Settlements](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/laws-cases\/lawsuits-settlements)\n- [News](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/news)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Consumer Protection Quarterly Newsletter](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/news\/consumer-protection-quarterly-newsletter)\n- [Publications](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/publications-forms)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Other Agency Publications](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/publications-forms\/outside-agency-s-publications)\n- [Contact Us](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/get-help)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Contact Us](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/get-help\/contact-us2 \"Contact form for the Attorney General of Virginia's Consumer Protection Unit\")\n\n![Richmond Capitol building and trees in the Capitol grounds](https:\/\/www.oag.state.va.us\/images\/capitol.jpg)\n\n# Consumer Protection\n[Filing a Complaint](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/file-a-complaint)\n\n[Search Our Complaint Database](https:\/\/www.oag.state.va.us\/consumer-protection\/complaint\/search)\n\n[Consumer Protection](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/tips-info2)\n\n[Subscribe](https:\/\/www.oag.state.va.us\/consumer-protection\/subscribe)\n\n[Virginia Consumer Laws & Cases](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/laws-cases)\n\n[Scams](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/scams-information)\n\n[Recent News](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/news\/)\n\n[About Us](https:\/\/www.oag.state.va.us\/consumer-protection\/about-us)\n\n## How can we help?\nMain Line: [804-786-2071](tel:804-786-2071)  \n Consumer Protection Hotline: [804-786-2042](tel:804-786-2042)  \n  Hours: 8:30 am - 5:00 pm Monday through Friday\n\n## Victims\nVictim Notification Program: [1-800-370-0459](tel:1-800-370-0459)\n\nOffice of Civil Rights: [804-225-2292](tel:804-225-2292)\n\n## Report Fraud\nReport Medicaid Fraud: [1-800-371-0824](tel:1-800-371-0824)\n\nReport Medicare Fraud: [1-800-HHS-TIPS](tel:1-800-447-8477) \/ TTY: [1-800-377-4950](tel:1-800-377-4950)\n\n![Virginia State Icon](https:\/\/www.oag.state.va.us\/templates\/g5_helium\/custom\/images\/Virginia.png)\n\n- [Webmaster](mailto:webmaster@oag.state.va.us \"Webmaster\")\n- [Web Policy](https:\/\/www.oag.state.va.us\/web-policy \"Web Policy\")\n- [FOIA Contact](https:\/\/www.oag.state.va.us\/files\/FOIA1.pdf \"FOIA Contact\")\n\n© Attorney General of Virginia 2026\n\n[Back to top](https:\/\/www.oag.state.va.us\/consumer-protection\/ \"Back to top\")","attrs_readable_markdown":"Jay Jones  Attorney General of Virginia\n\n- [OAG Main](https:\/\/www.oag.state.va.us\/)\n- [Home](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php)\n- [File a Complaint](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/file-a-complaint)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Agency Search](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/file-a-complaint\/agency-search)\n- [Complaint Database](https:\/\/www.oag.state.va.us\/consumer-protection\/complaint\/search)\n- [Scams](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/scams-information)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Scam Alerts Archive](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/scams-information\/scam-alerts-archive)\n- [Tips & Info](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/tips-info2)\n- [Laws & Cases](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/laws-cases)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Lawsuits & Settlements](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/laws-cases\/lawsuits-settlements)\n- [News](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/news)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Consumer Protection Quarterly Newsletter](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/news\/consumer-protection-quarterly-newsletter)\n- [Publications](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/publications-forms)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Other Agency Publications](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/publications-forms\/outside-agency-s-publications)\n- [Contact Us](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/get-help)\n  - - [Back](https:\/\/www.oag.state.va.us\/consumer-protection\/)\n    - [Contact Us](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/get-help\/contact-us2 \"Contact form for the Attorney General of Virginia's Consumer Protection Unit\")\n\n![Richmond Capitol building and trees in the Capitol grounds](https:\/\/www.oag.state.va.us\/images\/capitol.jpg)\n\nConsumer Protection\n\n[Filing a Complaint](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/file-a-complaint)\n\n[Search Our Complaint Database](https:\/\/www.oag.state.va.us\/consumer-protection\/complaint\/search)\n\n[Consumer Protection](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/tips-info2)\n\n[Subscribe](https:\/\/www.oag.state.va.us\/consumer-protection\/subscribe)\n\n[Virginia Consumer Laws & Cases](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/laws-cases)\n\n[Scams](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/scams-information)\n\n[Recent News](https:\/\/www.oag.state.va.us\/consumer-protection\/index.php\/news\/)\n\n[About Us](https:\/\/www.oag.state.va.us\/consumer-protection\/about-us)","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

11 hours ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.oag.state.va.us/consumer-protection/
Last Crawled	2026-04-09 23:46:52 (11 hours ago)
First Indexed	2017-09-16 12:04:58 (8 years ago)
HTTP Status Code	200
Meta Title	Home
Meta Description	null
Meta Canonical	null
Boilerpipe Text	Jay Jones Attorney General of Virginia OAG Main Home File a Complaint Back Agency Search Complaint Database Scams Back Scam Alerts Archive Tips & Info Laws & Cases Back Lawsuits & Settlements News Back Consumer Protection Quarterly Newsletter Publications Back Other Agency Publications Contact Us Back Contact Us Consumer Protection Filing a Complaint Search Our Complaint Database Consumer Protection Subscribe Virginia Consumer Laws & Cases Scams Recent News About Us
Markdown	# Jay Jones Attorney General of Virginia - [OAG Main](https://www.oag.state.va.us/) - [Home](https://www.oag.state.va.us/consumer-protection/index.php) - [File a Complaint](https://www.oag.state.va.us/consumer-protection/index.php/file-a-complaint) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Agency Search](https://www.oag.state.va.us/consumer-protection/index.php/file-a-complaint/agency-search) - [Complaint Database](https://www.oag.state.va.us/consumer-protection/complaint/search) - [Scams](https://www.oag.state.va.us/consumer-protection/index.php/scams-information) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Scam Alerts Archive](https://www.oag.state.va.us/consumer-protection/index.php/scams-information/scam-alerts-archive) - [Tips & Info](https://www.oag.state.va.us/consumer-protection/index.php/tips-info2) - [Laws & Cases](https://www.oag.state.va.us/consumer-protection/index.php/laws-cases) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Lawsuits & Settlements](https://www.oag.state.va.us/consumer-protection/index.php/laws-cases/lawsuits-settlements) - [News](https://www.oag.state.va.us/consumer-protection/index.php/news) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Consumer Protection Quarterly Newsletter](https://www.oag.state.va.us/consumer-protection/index.php/news/consumer-protection-quarterly-newsletter) - [Publications](https://www.oag.state.va.us/consumer-protection/index.php/publications-forms) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Other Agency Publications](https://www.oag.state.va.us/consumer-protection/index.php/publications-forms/outside-agency-s-publications) - [Contact Us](https://www.oag.state.va.us/consumer-protection/index.php/get-help) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Contact Us](https://www.oag.state.va.us/consumer-protection/index.php/get-help/contact-us2 "Contact form for the Attorney General of Virginia's Consumer Protection Unit") ![Richmond Capitol building and trees in the Capitol grounds](https://www.oag.state.va.us/images/capitol.jpg) # Consumer Protection [Filing a Complaint](https://www.oag.state.va.us/consumer-protection/index.php/file-a-complaint) [Search Our Complaint Database](https://www.oag.state.va.us/consumer-protection/complaint/search) [Consumer Protection](https://www.oag.state.va.us/consumer-protection/index.php/tips-info2) [Subscribe](https://www.oag.state.va.us/consumer-protection/subscribe) [Virginia Consumer Laws & Cases](https://www.oag.state.va.us/consumer-protection/index.php/laws-cases) [Scams](https://www.oag.state.va.us/consumer-protection/index.php/scams-information) [Recent News](https://www.oag.state.va.us/consumer-protection/index.php/news/) [About Us](https://www.oag.state.va.us/consumer-protection/about-us) ## How can we help? Main Line: [804-786-2071](tel:804-786-2071) Consumer Protection Hotline: [804-786-2042](tel:804-786-2042) Hours: 8:30 am - 5:00 pm Monday through Friday ## Victims Victim Notification Program: [1-800-370-0459](tel:1-800-370-0459) Office of Civil Rights: [804-225-2292](tel:804-225-2292) ## Report Fraud Report Medicaid Fraud: [1-800-371-0824](tel:1-800-371-0824) Report Medicare Fraud: [1-800-HHS-TIPS](tel:1-800-447-8477) / TTY: [1-800-377-4950](tel:1-800-377-4950) ![Virginia State Icon](https://www.oag.state.va.us/templates/g5_helium/custom/images/Virginia.png) - [Webmaster](mailto:webmaster@oag.state.va.us "Webmaster") - [Web Policy](https://www.oag.state.va.us/web-policy "Web Policy") - [FOIA Contact](https://www.oag.state.va.us/files/FOIA1.pdf "FOIA Contact") © Attorney General of Virginia 2026 [Back to top](https://www.oag.state.va.us/consumer-protection/ "Back to top")
Readable Markdown	Jay Jones Attorney General of Virginia - [OAG Main](https://www.oag.state.va.us/) - [Home](https://www.oag.state.va.us/consumer-protection/index.php) - [File a Complaint](https://www.oag.state.va.us/consumer-protection/index.php/file-a-complaint) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Agency Search](https://www.oag.state.va.us/consumer-protection/index.php/file-a-complaint/agency-search) - [Complaint Database](https://www.oag.state.va.us/consumer-protection/complaint/search) - [Scams](https://www.oag.state.va.us/consumer-protection/index.php/scams-information) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Scam Alerts Archive](https://www.oag.state.va.us/consumer-protection/index.php/scams-information/scam-alerts-archive) - [Tips & Info](https://www.oag.state.va.us/consumer-protection/index.php/tips-info2) - [Laws & Cases](https://www.oag.state.va.us/consumer-protection/index.php/laws-cases) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Lawsuits & Settlements](https://www.oag.state.va.us/consumer-protection/index.php/laws-cases/lawsuits-settlements) - [News](https://www.oag.state.va.us/consumer-protection/index.php/news) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Consumer Protection Quarterly Newsletter](https://www.oag.state.va.us/consumer-protection/index.php/news/consumer-protection-quarterly-newsletter) - [Publications](https://www.oag.state.va.us/consumer-protection/index.php/publications-forms) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Other Agency Publications](https://www.oag.state.va.us/consumer-protection/index.php/publications-forms/outside-agency-s-publications) - [Contact Us](https://www.oag.state.va.us/consumer-protection/index.php/get-help) - - [Back](https://www.oag.state.va.us/consumer-protection/) - [Contact Us](https://www.oag.state.va.us/consumer-protection/index.php/get-help/contact-us2 "Contact form for the Attorney General of Virginia's Consumer Protection Unit") ![Richmond Capitol building and trees in the Capitol grounds](https://www.oag.state.va.us/images/capitol.jpg) Consumer Protection [Filing a Complaint](https://www.oag.state.va.us/consumer-protection/index.php/file-a-complaint) [Search Our Complaint Database](https://www.oag.state.va.us/consumer-protection/complaint/search) [Consumer Protection](https://www.oag.state.va.us/consumer-protection/index.php/tips-info2) [Subscribe](https://www.oag.state.va.us/consumer-protection/subscribe) [Virginia Consumer Laws & Cases](https://www.oag.state.va.us/consumer-protection/index.php/laws-cases) [Scams](https://www.oag.state.va.us/consumer-protection/index.php/scams-information) [Recent News](https://www.oag.state.va.us/consumer-protection/index.php/news/) [About Us](https://www.oag.state.va.us/consumer-protection/about-us)
Shard	17 (laksa)
Root Hash	15077382450256512217
Unparsed URL	us,va,state!oag,www,/consumer-protection/ s443