🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 132 (from laksa058)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa132.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.bbc.co.uk/programmes/w3ct1d1b\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.bbc.co.uk/programmes/w3ct1d1b\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.bbc.co.uk\/programmes\/w3ct1d1b","crawl_time":1760649341,"first_indexed_time":1609669025,"http_code":200,"src_unparsed":"uk,co,bbc!www,\/programmes\/w3ct1d1b s443","src_root_hash":"2272746388958996332","history_drop_reason":null,"meta_title":"BBC World Service - The Documentary, Donald Trump: The man","meta_descriptions":["The businessman and TV show host who became the 45th President of the United States"],"attrs_boilerpipe_text":null,"attrs_markdown":"## We've updated our Privacy and Cookies Policy\nWe've made some important changes to our Privacy and Cookies Policy and we want you to know what this means for you and your data.\n\nOK\n\n[Find out what's changed](https:\/\/www.bbc.co.uk\/usingthebbc\/your-data-matters)\n\n## Cookies on the BBC website\n[We use cookies](https:\/\/www.bbc.co.uk\/usingthebbc\/cookies\/what-do-i-need-to-know-about-cookies\/) to give you the best online experience. Strictly necessary cookies are **on** by default. Additional cookies are **off** by default.\n\nAccept additional cookies\n\nReject additional cookies\n\n[Let me choose](https:\/\/www.bbc.co.uk\/usingthebbc\/cookies\/how-can-i-change-my-bbc-cookie-settings\/)\n\n![](https:\/\/a1.api.bbc.co.uk\/hit.xiti?&col=1&from=p&ptag=js&s=598253&p=episode::unknown&x1=[urn:bbc:pips:w3ct1d1b]&x2=[responsive]&x3=[bbc_website]&x4=[en]&x7=[episode]&x8=[reverb-3.9.2-nojs]&x11=[ws_programmes]&x12=[WORLD_SERVICE_ENGLISH])\n\n[Homepage](https:\/\/www.bbc.co.uk\/)\n\n## Accessibility links\n- [Skip to content](https:\/\/www.bbc.co.uk\/programmes\/w3ct1d1b#programmes-content)\n- [Accessibility Help](https:\/\/www.bbc.co.uk\/accessibility\/)\n\n[Close menu](https:\/\/www.bbc.co.uk\/programmes\/w3ct1d1b)\n\nBBC World Service\n\n[The Documentary](https:\/\/www.bbc.co.uk\/programmes\/p00fvhsf)\n\nMore\n\n- [Podcast](https:\/\/www.bbc.co.uk\/programmes\/p02nq0lx\/episodes\/downloads)\n- [The Explanation](https:\/\/www.bbc.co.uk\/programmes\/w13xtvml\/episodes\/downloads)\n- [People Fixing the World](https:\/\/www.bbc.co.uk\/programmes\/p04grdbc\/episodes\/downloads)\n- [CrowdScience](https:\/\/www.bbc.co.uk\/programmes\/p04d42rc\/episodes\/downloads)\n\nMain content\n\n[![](https:\/\/ichef.bbci.co.uk\/images\/ic\/640x360\/p0923xfs.jpg) Listen now](https:\/\/www.bbc.co.uk\/sounds\/play\/w3ct1d1b)\n\n# Donald Trump: The man\n[The Documentary](https:\/\/www.bbc.co.uk\/programmes\/p00fvhsf)\n\nDonald Trump was the businessman and TV show host who became the 45th President of the United States.\n\nShow more\n\nDonald Trump was the businessman and TV show host who became the 45th President of the United States, with huge power and resources at his fingertips. Rob Watson tells the life story of one of the most extraordinary people to occupy the Oval Office.\n\n(Photo: US President Donald Trump on the second day of his state visit to London 4 June 2019)\n\nShow less\n\nAvailable now\n\n23 minutes\n\n## Last on\n![](https:\/\/programmes.files.bbci.co.uk\/programmes-frontend\/images\/logos\/svg\/bbc_world_service\/service-232dde8eca.svg)\n\nTue 5 Jan 2021 09:06  Local time\n\nBBC World Service\n\n## More episodes\n### Previous\n#### [Breakthrough: The race for the Covid vaccine](https:\/\/www.bbc.co.uk\/programmes\/w3ct1d08)\n\n### Next\n#### [Donald Trump: The political record](https:\/\/www.bbc.co.uk\/programmes\/w3ct1d1c)\n\n[See all episodes from The Documentary](https:\/\/www.bbc.co.uk\/programmes\/p00fvhsf\/episodes)\n\n## Broadcasts\n- ![](https:\/\/programmes.files.bbci.co.uk\/programmes-frontend\/images\/logos\/svg\/bbc_world_service\/service-232dde8eca.svg)\n  \n  Tue 5 Jan 2021 04:06  Local time\n  \n  BBC World Service\n- ![](https:\/\/programmes.files.bbci.co.uk\/programmes-frontend\/images\/logos\/svg\/bbc_world_service\/service-232dde8eca.svg)\n  \n  Tue 5 Jan 2021 09:06  Local time\n  \n  BBC World Service\n\n## Related Content\n### Similar programmes\n#### By genre:\n- [Factual](https:\/\/www.bbc.co.uk\/programmes\/genres\/factual)\n\n#### By format:\n- [Documentaries](https:\/\/www.bbc.co.uk\/programmes\/formats\/documentaries)\n\n![BBC World Service homepage](https:\/\/programmes.files.bbci.co.uk\/programmes-frontend\/images\/logos\/svg\/bbc_world_service\/service-232dde8eca.svg)\n\n[Listen live](https:\/\/www.bbc.co.uk\/sounds\/play\/live\/bbc_world_service)\n\n09:32 GMT\n\n[![](https:\/\/ichef.bbci.co.uk\/images\/ic\/160x90\/p0m1ljc1.jpg) World of Secrets](https:\/\/www.bbc.co.uk\/programmes\/w3ct854q)\n\n- [Online schedule](https:\/\/www.bbc.co.uk\/schedules\/p00fzl9p)\n- [Downloads](http:\/\/www.bbc.co.uk\/podcasts\/worldserviceradio)\n- [Help & FAQs](http:\/\/www.bbc.co.uk\/programmes\/articles\/5nCxH0NlsPtyW8WvJ0rwDJP\/about-world-service-radio)\n- [Contact us](http:\/\/www.bbc.co.uk\/programmes\/articles\/5nCxH0NlsPtyW8WvJ0rwDJP\/about-world-service-radio)\n- [News in 39 languages](http:\/\/www.bbc.co.uk\/worldservice\/languages\/index.shtml)\n\n- [Terms of Use](https:\/\/www.bbc.co.uk\/usingthebbc\/terms\/)\n- [About the BBC](https:\/\/www.bbc.co.uk\/aboutthebbc)\n- [Privacy Policy](https:\/\/www.bbc.co.uk\/usingthebbc\/privacy\/)\n- [Privacy Policy](https:\/\/www.bbc.com\/usingthebbc\/privacy\/)\n- [Cookies](https:\/\/www.bbc.co.uk\/usingthebbc\/cookies\/)\n- [Cookies](https:\/\/www.bbc.com\/usingthebbc\/cookies\/)\n- [Accessibility Help](https:\/\/www.bbc.co.uk\/accessibility\/)\n- [Parental Guidance](https:\/\/www.bbc.co.uk\/guidance)\n- [Contact the BBC](https:\/\/www.bbc.co.uk\/contact)\n- [Make an editorial complaint](https:\/\/www.bbc.co.uk\/contact\/complaints\/)\n- [BBC emails for you](https:\/\/www.bbc.co.uk\/bbcnewsletter)\n- [Advertise with us](https:\/\/www.bbc.com\/advertisingcontact)\n\n*Copyright © 2025 BBC.* The BBC is not responsible for the content of external sites.   [Read about our approach to external linking.](https:\/\/www.bbc.co.uk\/editorialguidelines\/guidance\/feeds-and-links)\n\n![](https:\/\/sb.scorecardresearch.com\/p?c1=2&c2=17986528&cs_ucfr=0&cv=2.0&cj=1)","attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

5 months ago

🚫

ROBOTS BLOCKED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	5.8 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.bbc.co.uk/programmes/w3ct1d1b
Last Crawled	2025-10-16 21:15:41 (5 months ago)
First Indexed	2021-01-03 10:17:05 (5 years ago)
HTTP Status Code	200
Meta Title	BBC World Service - The Documentary, Donald Trump: The man
Meta Description	The businessman and TV show host who became the 45th President of the United States
Meta Canonical	null
Boilerpipe Text	null
Markdown	## We've updated our Privacy and Cookies Policy We've made some important changes to our Privacy and Cookies Policy and we want you to know what this means for you and your data. OK [Find out what's changed](https://www.bbc.co.uk/usingthebbc/your-data-matters) ## Cookies on the BBC website [We use cookies](https://www.bbc.co.uk/usingthebbc/cookies/what-do-i-need-to-know-about-cookies/) to give you the best online experience. Strictly necessary cookies are on by default. Additional cookies are off by default. Accept additional cookies Reject additional cookies [Let me choose](https://www.bbc.co.uk/usingthebbc/cookies/how-can-i-change-my-bbc-cookie-settings/) ![](https://a1.api.bbc.co.uk/hit.xiti?&col=1&from=p&ptag=js&s=598253&p=episode::unknown&x1=[urn:bbc:pips:w3ct1d1b]&x2=[responsive]&x3=[bbc_website]&x4=[en]&x7=[episode]&x8=[reverb-3.9.2-nojs]&x11=[ws_programmes]&x12=[WORLD_SERVICE_ENGLISH]) [Homepage](https://www.bbc.co.uk/) ## Accessibility links - [Skip to content](https://www.bbc.co.uk/programmes/w3ct1d1b#programmes-content) - [Accessibility Help](https://www.bbc.co.uk/accessibility/) [Close menu](https://www.bbc.co.uk/programmes/w3ct1d1b) BBC World Service [The Documentary](https://www.bbc.co.uk/programmes/p00fvhsf) More - [Podcast](https://www.bbc.co.uk/programmes/p02nq0lx/episodes/downloads) - [The Explanation](https://www.bbc.co.uk/programmes/w13xtvml/episodes/downloads) - [People Fixing the World](https://www.bbc.co.uk/programmes/p04grdbc/episodes/downloads) - [CrowdScience](https://www.bbc.co.uk/programmes/p04d42rc/episodes/downloads) Main content [![](https://ichef.bbci.co.uk/images/ic/640x360/p0923xfs.jpg) Listen now](https://www.bbc.co.uk/sounds/play/w3ct1d1b) # Donald Trump: The man [The Documentary](https://www.bbc.co.uk/programmes/p00fvhsf) Donald Trump was the businessman and TV show host who became the 45th President of the United States. Show more Donald Trump was the businessman and TV show host who became the 45th President of the United States, with huge power and resources at his fingertips. Rob Watson tells the life story of one of the most extraordinary people to occupy the Oval Office. (Photo: US President Donald Trump on the second day of his state visit to London 4 June 2019) Show less Available now 23 minutes ## Last on ![](https://programmes.files.bbci.co.uk/programmes-frontend/images/logos/svg/bbc_world_service/service-232dde8eca.svg) Tue 5 Jan 2021 09:06 Local time BBC World Service ## More episodes ### Previous #### [Breakthrough: The race for the Covid vaccine](https://www.bbc.co.uk/programmes/w3ct1d08) ### Next #### [Donald Trump: The political record](https://www.bbc.co.uk/programmes/w3ct1d1c) [See all episodes from The Documentary](https://www.bbc.co.uk/programmes/p00fvhsf/episodes) ## Broadcasts - ![](https://programmes.files.bbci.co.uk/programmes-frontend/images/logos/svg/bbc_world_service/service-232dde8eca.svg) Tue 5 Jan 2021 04:06 Local time BBC World Service - ![](https://programmes.files.bbci.co.uk/programmes-frontend/images/logos/svg/bbc_world_service/service-232dde8eca.svg) Tue 5 Jan 2021 09:06 Local time BBC World Service ## Related Content ### Similar programmes #### By genre: - [Factual](https://www.bbc.co.uk/programmes/genres/factual) #### By format: - [Documentaries](https://www.bbc.co.uk/programmes/formats/documentaries) ![BBC World Service homepage](https://programmes.files.bbci.co.uk/programmes-frontend/images/logos/svg/bbc_world_service/service-232dde8eca.svg) [Listen live](https://www.bbc.co.uk/sounds/play/live/bbc_world_service) 09:32 GMT [![](https://ichef.bbci.co.uk/images/ic/160x90/p0m1ljc1.jpg) World of Secrets](https://www.bbc.co.uk/programmes/w3ct854q) - [Online schedule](https://www.bbc.co.uk/schedules/p00fzl9p) - [Downloads](http://www.bbc.co.uk/podcasts/worldserviceradio) - [Help & FAQs](http://www.bbc.co.uk/programmes/articles/5nCxH0NlsPtyW8WvJ0rwDJP/about-world-service-radio) - [Contact us](http://www.bbc.co.uk/programmes/articles/5nCxH0NlsPtyW8WvJ0rwDJP/about-world-service-radio) - [News in 39 languages](http://www.bbc.co.uk/worldservice/languages/index.shtml) - [Terms of Use](https://www.bbc.co.uk/usingthebbc/terms/) - [About the BBC](https://www.bbc.co.uk/aboutthebbc) - [Privacy Policy](https://www.bbc.co.uk/usingthebbc/privacy/) - [Privacy Policy](https://www.bbc.com/usingthebbc/privacy/) - [Cookies](https://www.bbc.co.uk/usingthebbc/cookies/) - [Cookies](https://www.bbc.com/usingthebbc/cookies/) - [Accessibility Help](https://www.bbc.co.uk/accessibility/) - [Parental Guidance](https://www.bbc.co.uk/guidance) - [Contact the BBC](https://www.bbc.co.uk/contact) - [Make an editorial complaint](https://www.bbc.co.uk/contact/complaints/) - [BBC emails for you](https://www.bbc.co.uk/bbcnewsletter) - [Advertise with us](https://www.bbc.com/advertisingcontact) Copyright © 2025 BBC. The BBC is not responsible for the content of external sites. [Read about our approach to external linking.](https://www.bbc.co.uk/editorialguidelines/guidance/feeds-and-links) ![](https://sb.scorecardresearch.com/p?c1=2&c2=17986528&cs_ucfr=0&cv=2.0&cj=1)
Readable Markdown	null
Shard	132 (laksa)
Root Hash	2272746388958996332
Unparsed URL	uk,co,bbc!www,/programmes/w3ct1d1b s443