🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 141 (from laksa170)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa141.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.dentalproductshopper.com/manufacturer/colgate\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.dentalproductshopper.com/manufacturer/colgate\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.dentalproductshopper.com\/manufacturer\/colgate","crawl_time":1776471349,"first_indexed_time":1539593352,"http_code":200,"src_unparsed":"com,dentalproductshopper!www,\/manufacturer\/colgate s443","src_root_hash":"8596578993102634941","history_drop_reason":null,"meta_title":"Colgate | Dental Product Shopper | DPS","meta_descriptions":[],"attrs_boilerpipe_text":"300 Park Avenue, NY, NY 10022","attrs_markdown":"Product Categories\n\n[![Dental Product Shopper Logo](https:\/\/www.dentalproductshopper.com\/_next\/image?url=%2Fimages%2FDPS-Logo.png&w=384&q=80)](https:\/\/www.dentalproductshopper.com\/)\n\n[Subscribe](https:\/\/www.dentalproductshopper.com\/subscribe)[About Us](https:\/\/www.dentalproductshopper.com\/about-us)[FAQ](https:\/\/www.dentalproductshopper.com\/faq)[Dental Learning - CE](https:\/\/www.dentallearning.net\/)\n\nContact\n\n[Contact Us](https:\/\/www.dentalproductshopper.com\/contact-us)[Advertise With Us](https:\/\/www.dentalproductshopper.com\/advertise-with-us)\n\n[Home](https:\/\/www.dentalproductshopper.com\/)[Newsfeed](https:\/\/www.dentalproductshopper.com\/newsfeed?page=1)[New Products](https:\/\/www.dentalproductshopper.com\/new-products)[Product Categories](https:\/\/www.dentalproductshopper.com\/product-categories)[Manufacturer Index](https:\/\/www.dentalproductshopper.com\/manufacturer-index)[Promotions](https:\/\/www.dentalproductshopper.com\/promotions)[Dental Forum](https:\/\/www.dentalxp.com\/forums?page=1)\n\n![content-instructor](https:\/\/www.dentalproductshopper.com\/_next\/image?url=%2Fimages%2FnewsModal%2Fsubscribe.png&w=3840&q=80)\n\n![content-instructor](https:\/\/www.dentalproductshopper.com\/_next\/image?url=%2Fimages%2FnewsModal%2Fsubscribe.png&w=3840&q=80)\n\nDental Insights\n\nNewsletter\n\n![content-instructor](https:\/\/www.dentalproductshopper.com\/_next\/image?url=%2Fimages%2FnewsModal%2Fmedia.png&w=3840&q=80)\n\nWe use cookies to make your experience on this website better.**Cookie Policies**\n\nClose\n\nAccept\n\n[Home](https:\/\/www.dentalproductshopper.com\/)\n\n### \/\n[Manufacturer Index](https:\/\/www.dentalproductshopper.com\/manufacturer-index)\n\n### \/\n### Colgate\n\n# Colgate\n<https:\/\/www.colgateprofessional.com>\n\n300 Park Avenue, NY, NY 10022\n\n1-800-226-5428\n\n[Kathryn\\_Parrish@colpal.com](mailto:Kathryn_Parrish@colpal.com)\n\n[facebook](https:\/\/www.facebook.com\/Colgate\/)\n\n\\|\n\n[instagram](https:\/\/www.instagram.com\/colgateprofesional\/)\n\n\\|\n\n[linkedin](https:\/\/www.linkedin.com\/company\/colgate-palmolive\/)\n\n![Colgate](https:\/\/www.dentalproductshopper.com\/_next\/image?url=https%3A%2F%2Fdh1bsjhakq06i.cloudfront.net%2FManufacturer_Logos%2FColgate_26885.gif&w=640&q=80)\n***\n[View All Colgate Products](https:\/\/www.dentalproductshopper.com\/products\/manufacturer\/26885)","attrs_readable_markdown":"300 Park Avenue, NY, NY 10022","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

5 hours ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.dentalproductshopper.com/manufacturer/colgate
Last Crawled	2026-04-18 00:15:49 (5 hours ago)
First Indexed	2018-10-15 08:49:12 (7 years ago)
HTTP Status Code	200
Meta Title	Colgate \| Dental Product Shopper \| DPS
Meta Description	null
Meta Canonical	null
Boilerpipe Text	300 Park Avenue, NY, NY 10022
Markdown	Product Categories [![Dental Product Shopper Logo](https://www.dentalproductshopper.com/_next/image?url=%2Fimages%2FDPS-Logo.png&w=384&q=80)](https://www.dentalproductshopper.com/) [Subscribe](https://www.dentalproductshopper.com/subscribe)[About Us](https://www.dentalproductshopper.com/about-us)[FAQ](https://www.dentalproductshopper.com/faq)[Dental Learning - CE](https://www.dentallearning.net/) Contact [Contact Us](https://www.dentalproductshopper.com/contact-us)[Advertise With Us](https://www.dentalproductshopper.com/advertise-with-us) [Home](https://www.dentalproductshopper.com/)[Newsfeed](https://www.dentalproductshopper.com/newsfeed?page=1)[New Products](https://www.dentalproductshopper.com/new-products)[Product Categories](https://www.dentalproductshopper.com/product-categories)[Manufacturer Index](https://www.dentalproductshopper.com/manufacturer-index)[Promotions](https://www.dentalproductshopper.com/promotions)[Dental Forum](https://www.dentalxp.com/forums?page=1) ![content-instructor](https://www.dentalproductshopper.com/_next/image?url=%2Fimages%2FnewsModal%2Fsubscribe.png&w=3840&q=80) ![content-instructor](https://www.dentalproductshopper.com/_next/image?url=%2Fimages%2FnewsModal%2Fsubscribe.png&w=3840&q=80) Dental Insights Newsletter ![content-instructor](https://www.dentalproductshopper.com/_next/image?url=%2Fimages%2FnewsModal%2Fmedia.png&w=3840&q=80) We use cookies to make your experience on this website better.Cookie Policies Close Accept [Home](https://www.dentalproductshopper.com/) ### / [Manufacturer Index](https://www.dentalproductshopper.com/manufacturer-index) ### / ### Colgate # Colgate <https://www.colgateprofessional.com> 300 Park Avenue, NY, NY 10022 1-800-226-5428 [Kathryn\_Parrish@colpal.com](mailto:Kathryn_Parrish@colpal.com) [facebook](https://www.facebook.com/Colgate/) \\| [instagram](https://www.instagram.com/colgateprofesional/) \\| [linkedin](https://www.linkedin.com/company/colgate-palmolive/) ![Colgate](https://www.dentalproductshopper.com/_next/image?url=https%3A%2F%2Fdh1bsjhakq06i.cloudfront.net%2FManufacturer_Logos%2FColgate_26885.gif&w=640&q=80) *** [View All Colgate Products](https://www.dentalproductshopper.com/products/manufacturer/26885)
Readable Markdown	300 Park Avenue, NY, NY 10022
Shard	141 (laksa)
Root Hash	8596578993102634941
Unparsed URL	com,dentalproductshopper!www,/manufacturer/colgate s443