🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 80 (from laksa094)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa080.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/default.aspx\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/default.aspx\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/default.aspx","crawl_time":1776201156,"first_indexed_time":1531345977,"http_code":200,"src_unparsed":"gov,ncdot!www,\/initiatives-policies\/safety\/driving-safety\/Pages\/default.aspx s443","src_root_hash":"1956336485138544080","history_drop_reason":null,"meta_title":"NCDOT: Driving Safety Guidelines & Laws","meta_descriptions":["N.C. Department of Transportation's information about laws, weather conditions, deer collisions, and other driving safety tips"],"attrs_boilerpipe_text":"\nSafety is the N.C. Department of Transportation's\r\nhighest priority when it comes to those who travel North Carolina's roads.\nBelow are some general guidelines for various\r\nsituations that can help drivers, motorcyclists\r\nand bicyclists safely arrive at their destinations.\nMore on driver safety can be found in the Division\r\nof Motor Vehicle's\ndriver's\r\nhandbooks\n(available in both English and Spanish). Safety guidelines are\r\nalso available for motorcyclists and bicyclists.\nNorth Carolina Driving Laws\nDriving in Work Zones\nDriving in Rainy Weather\nDriving in Winter Weather\nMove Over Law\n \n\nNight Driving & Time Changes\nAvoiding Distracted Driving\n\nAvoiding Collisions With Deer\nSchool Bus Safety\nTeen Drivers: Start the Conversation\nRelated Links","attrs_markdown":null,"attrs_readable_markdown":"\n\n![Driving Safety & Laws](https:\/\/www.ncdot.gov\/news\/RR_IMAGE_CATALOG\/people\/ren\/ren-BIKEPED36.jpg?RenditionID=17)\n\nSafety is the N.C. Department of Transportation's highest priority when it comes to those who travel North Carolina's roads.\n\nBelow are some general guidelines for various situations that can help drivers, motorcyclists and bicyclists safely arrive at their destinations.\n\nMore on driver safety can be found in the Division of Motor Vehicle's [driver's handbooks](https:\/\/www.ncdot.gov\/dmv\/help\/Pages\/handbooks.aspx) (available in both English and Spanish). Safety guidelines are also available for motorcyclists and bicyclists.\n\n- [North Carolina Driving Laws](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/driving-laws.aspx)\n- [Driving in Work Zones](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/work-zones.aspx)\n- [Driving in Rainy Weather](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/wet-weather.aspx)\n- [Driving in Winter Weather](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/winter-weather.aspx)\n- [Move Over Law](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/move-over-law.aspx \"Move Over Law\")\n- [Night Driving & Time Changes](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/night-driving-time-changes.aspx)\n- [Avoiding Distracted Driving](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/distracted-driving.aspx)\n- [Avoiding Collisions With Deer](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/deer-collisions.aspx)\n- [School Bus Safety](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/school-bus-safety.aspx)\n- [Teen Drivers: Start the Conversation](https:\/\/www.ncdot.gov\/initiatives-policies\/safety\/driving-safety\/Pages\/teen-driver-safety.aspx)\n## Related Links","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

1 day ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/default.aspx
Last Crawled	2026-04-14 21:12:36 (1 day ago)
First Indexed	2018-07-11 21:52:57 (7 years ago)
HTTP Status Code	200
Meta Title	NCDOT: Driving Safety Guidelines & Laws
Meta Description	N.C. Department of Transportation's information about laws, weather conditions, deer collisions, and other driving safety tips
Meta Canonical	null
Boilerpipe Text	Safety is the N.C. Department of Transportation's highest priority when it comes to those who travel North Carolina's roads. Below are some general guidelines for various situations that can help drivers, motorcyclists and bicyclists safely arrive at their destinations. More on driver safety can be found in the Division of Motor Vehicle's driver's handbooks (available in both English and Spanish). Safety guidelines are also available for motorcyclists and bicyclists. North Carolina Driving Laws Driving in Work Zones Driving in Rainy Weather Driving in Winter Weather Move Over Law Night Driving & Time Changes Avoiding Distracted Driving Avoiding Collisions With Deer School Bus Safety Teen Drivers: Start the Conversation Related Links
Markdown	null
Readable Markdown	![Driving Safety & Laws](https://www.ncdot.gov/news/RR_IMAGE_CATALOG/people/ren/ren-BIKEPED36.jpg?RenditionID=17) Safety is the N.C. Department of Transportation's highest priority when it comes to those who travel North Carolina's roads. Below are some general guidelines for various situations that can help drivers, motorcyclists and bicyclists safely arrive at their destinations. More on driver safety can be found in the Division of Motor Vehicle's [driver's handbooks](https://www.ncdot.gov/dmv/help/Pages/handbooks.aspx) (available in both English and Spanish). Safety guidelines are also available for motorcyclists and bicyclists. - [North Carolina Driving Laws](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/driving-laws.aspx) - [Driving in Work Zones](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/work-zones.aspx) - [Driving in Rainy Weather](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/wet-weather.aspx) - [Driving in Winter Weather](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/winter-weather.aspx) - [Move Over Law](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/move-over-law.aspx "Move Over Law") - [Night Driving & Time Changes](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/night-driving-time-changes.aspx) - [Avoiding Distracted Driving](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/distracted-driving.aspx) - [Avoiding Collisions With Deer](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/deer-collisions.aspx) - [School Bus Safety](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/school-bus-safety.aspx) - [Teen Drivers: Start the Conversation](https://www.ncdot.gov/initiatives-policies/safety/driving-safety/Pages/teen-driver-safety.aspx) ## Related Links
Shard	80 (laksa)
Root Hash	1956336485138544080
Unparsed URL	gov,ncdot!www,/initiatives-policies/safety/driving-safety/Pages/default.aspx s443