🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 16 (from laksa162)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa016.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://www.wqxr.org/story/trump-billy-bush-and-problems-male-language\')), getAhrefsUnparsedNoserviceFromURL(\'https://www.wqxr.org/story/trump-billy-bush-and-problems-male-language\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/www.wqxr.org\/story\/trump-billy-bush-and-problems-male-language","crawl_time":1775836790,"first_indexed_time":0,"http_code":200,"src_unparsed":"org,wqxr!www,\/story\/trump-billy-bush-and-problems-male-language s443","src_root_hash":"779283536040568016","history_drop_reason":null,"meta_title":"Donald Trump, Billy Bush, and The Real Problem With 'Locker Room Talk' | The Takeaway | WQXR","meta_descriptions":["","Yes, men boast and engage in explicit sexual conversation when they're alone, but this type of language has consequences that extend far beyond the \"locker room.\""],"attrs_boilerpipe_text":"The Takeaway was a national daily news show from WNYC, PRX and WGBH that aired for 15 years on public radio.\nProduced by\nGBH\n,\nPRX\nand\nWNYC Studios\n.","attrs_markdown":"A list of our sites\n\n[NYPR Network]()\n\n[NYPR Network]()\n\n# WQXR Navigation\n[Donate](https:\/\/pledge.wqxr.org\/support\/wqxr?utm_source=wqxr&utm_medium=wqxr&utm_campaign=donate-button%20 \"Donate\")\n\n[Member Center](https:\/\/pledge.wnyc.org\/user\/email-link \"Member Center\")\n\n# WQXR Navigation\n- Listen Live\n  Listen Live\n- [All Streams](https:\/\/www.wqxr.org\/streams)\n- [Play History](https:\/\/www.wqxr.org\/playlist-daily)\n- [Schedule](https:\/\/www.wqxr.org\/schedule)\n- [Programs](https:\/\/www.wqxr.org\/shows)\n- [Features](https:\/\/www.wqxr.org\/articles\/wqxr-features\/)\n- [Podcasts](https:\/\/www.wqxr.org\/shows\/wqxr-podcasts\/)\n- [Videos](https:\/\/www.wqxr.org\/videos)\n- [Archives](https:\/\/www.wqxr.org\/series\/wqxr-archives\/)\n- [Live Broadcasts](https:\/\/www.wqxr.org\/shows\/live-broadcasts\/)\n- [Support Us](https:\/\/www.nypublicradio.org\/support\/)\n- [Search](https:\/\/www.wqxr.org\/search\/)\n### Follow WQXR\n\n[![The Takeaway](https:\/\/media.wnyc.org\/i\/50\/50\/l\/99\/1\/TheTakeway_Square_NoWNYCStudios.png) The Takeaway](https:\/\/www.wnycstudios.org\/podcasts\/takeaway)\n\nPublished by\n\n[The Takeaway](https:\/\/www.wnycstudios.org\/podcasts\/takeaway)\n# Donald Trump, Billy Bush, and The Real Problem With 'Locker Room Talk'\nListen 11 min\n\nOct 11, 2016\n\nFrom     [![PRI (Opens in new window)](https:\/\/media.wnyc.org\/i\/0\/15\/l\/99\/1\/PRI_logo_blk_horiz.png)](http:\/\/www.pri.org\/)    and    [![WNYC (Opens in new window)](https:\/\/media.wnyc.org\/i\/0\/15\/l\/99\/1\/wnyc-logo.png)](http:\/\/www.wnyc.org\/)\n# Post a Comment\n\n# The Takeaway\nThe Takeaway was a national daily news show from WNYC, PRX and WGBH that aired for 15 years on public radio.\n\nProduced by [GBH](http:\/\/www.wgbh.org\/), [PRX](http:\/\/www.prx.org\/) and [WNYC Studios](https:\/\/www.wnycstudios.org\/).\n\nSubscribe to the podcast ▾\n\n# Document Footer\n## WQXR\n- [Music Playlists](https:\/\/www.wqxr.org\/playlist-daily \"Playlists\")\n- [WQXR Schedule](https:\/\/www.wqxr.org\/schedule\/ \"Schedule\")\n- [Programs](https:\/\/www.wqxr.org\/shows \"Programs\")\n- [Hosts](https:\/\/www.wqxr.org\/hosts\/ \"Hosts\")\n- [Podcasts](https:\/\/www.wqxr.org\/shows\/wqxr-podcasts\/ \"Podcasts\")\n- [Videos](https:\/\/www.youtube.com\/wqxrclassical \"Videos\")\n- [WQXR Features](https:\/\/www.wqxr.org\/articles\/wqxr-features \"WQXR Features\")\n- [Operavore](https:\/\/www.wqxr.org\/blogs\/operavore\/ \"Operavore\")\n- [WQXR Archives](https:\/\/www.wnyc.org\/series\/wqxr-archives \"WQXR Archives\")\n\n## New Sounds\n- [Homepage](http:\/\/www.newsounds.org\/ \"Homepage\")\n- [Playlists](https:\/\/www.newsounds.org\/livestream \"Playlists\")\n- [On-Demand Concerts](https:\/\/www.wqxr.org\/shows\/newyorknow\/ \"On-Demand Concerts\")\n- [Soundcheck Podcast](https:\/\/www.newsounds.org\/shows\/soundcheck \"Soundcheck Podcast\")\n- [About New Sounds](http:\/\/www.newsounds.org\/about \"About New Sounds\")\n\n## About Us\n- [Mobile Apps](https:\/\/www.wqxr.org\/mobile-apps\/ \"Mobile Apps\")\n- [Support Us](https:\/\/www.nypublicradio.org\/support\/ \"Support Us\")\n- [About WQXR](https:\/\/www.wqxr.org\/about\/ \"About WQXR\")\n- [Audio Help](https:\/\/www.wqxr.org\/audio\/help-new-player\/ \"Audio Help\")\n- [Contact Us](https:\/\/www.wqxr.org\/contact\/ \"Contact Us\")\n- [Online Member Center](https:\/\/pledge.wqxr.org\/user\/email-link \"Member Center\")\n- [Jobs](https:\/\/nypublicradio.org\/careers\/ \"Jobs\")\n- [Diversity (DEI)](https:\/\/www.nypublicradio.org\/diversity-dei-overview\/ \"Diversity (DEI)\")\n- [Sponsorship](https:\/\/www.wqxr.org\/underwriting\/ \"Sponsorship\")\n- [Community Advisory Board](http:\/\/www.wqxr.org\/outreach\/cab\/ \"Community Advisory Board\")\n- [NY Public Radio](http:\/\/nypublicradio.org\/ \"NY Public Radio\")\n- [Giveaway Rules](https:\/\/www.wqxr.org\/articles\/wqxr-and-q2-music-contest-rules\/ \"Giveaway Rules\")\n\n## Connect\n- [Facebook](http:\/\/www.facebook.com\/WQXRClassical \"Facebook\")\n- [Twitter](http:\/\/www.twitter.com\/WQXR \"Twitter\")\n- [Instagram](https:\/\/www.instagram.com\/wqxr_classical\/ \"Instagram\")\n- [YouTube](http:\/\/www.youtube.com\/user\/WQXRClassical \"YouTube\")\n- [RSS](https:\/\/www.wqxr.org\/feeds\/all\/ \"RSS\")\n\n© 2026 New York Public Radio  \n All Rights Reserved.\n\nWQXR is supported by\n\n- [Terms of Use](https:\/\/www.wqxr.org\/terms\/ \"Terms of Use\")\n- [Privacy](https:\/\/www.wqxr.org\/privacy\/ \"Privacy\")\n- [Accessibility](https:\/\/media.wnyc.org\/media\/resources\/2022\/May\/06\/accessibility_policy_5.6.22.pdf \"Accessibility\")\n- [WQXR FCC Public File](https:\/\/publicfiles.fcc.gov\/fm-profile\/wqxr-fm \"WQXR FCC Public File\")\n- [EEO Report](https:\/\/www.wnyc.org\/resources\/912769\/fcc_eeo_public_file_report.pdf \"EEO Report\")","attrs_readable_markdown":"The Takeaway was a national daily news show from WNYC, PRX and WGBH that aired for 15 years on public radio.\n\nProduced by [GBH](http:\/\/www.wgbh.org\/), [PRX](http:\/\/www.prx.org\/) and [WNYC Studios](https:\/\/www.wnycstudios.org\/).","meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

10 days ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	0.3 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://www.wqxr.org/story/trump-billy-bush-and-problems-male-language
Last Crawled	2026-04-10 15:59:50 (10 days ago)
First Indexed	not set
HTTP Status Code	200
Meta Title	Donald Trump, Billy Bush, and The Real Problem With 'Locker Room Talk' \| The Takeaway \| WQXR
Meta Description	, Yes, men boast and engage in explicit sexual conversation when they're alone, but this type of language has consequences that extend far beyond the "locker room."
Meta Canonical	null
Boilerpipe Text	The Takeaway was a national daily news show from WNYC, PRX and WGBH that aired for 15 years on public radio. Produced by GBH , PRX and WNYC Studios .
Markdown	A list of our sites [NYPR Network]() [NYPR Network]() # WQXR Navigation [Donate](https://pledge.wqxr.org/support/wqxr?utm_source=wqxr&utm_medium=wqxr&utm_campaign=donate-button%20 "Donate") [Member Center](https://pledge.wnyc.org/user/email-link "Member Center") # WQXR Navigation - Listen Live Listen Live - [All Streams](https://www.wqxr.org/streams) - [Play History](https://www.wqxr.org/playlist-daily) - [Schedule](https://www.wqxr.org/schedule) - [Programs](https://www.wqxr.org/shows) - [Features](https://www.wqxr.org/articles/wqxr-features/) - [Podcasts](https://www.wqxr.org/shows/wqxr-podcasts/) - [Videos](https://www.wqxr.org/videos) - [Archives](https://www.wqxr.org/series/wqxr-archives/) - [Live Broadcasts](https://www.wqxr.org/shows/live-broadcasts/) - [Support Us](https://www.nypublicradio.org/support/) - [Search](https://www.wqxr.org/search/) ### Follow WQXR [![The Takeaway](https://media.wnyc.org/i/50/50/l/99/1/TheTakeway_Square_NoWNYCStudios.png) The Takeaway](https://www.wnycstudios.org/podcasts/takeaway) Published by [The Takeaway](https://www.wnycstudios.org/podcasts/takeaway) # Donald Trump, Billy Bush, and The Real Problem With 'Locker Room Talk' Listen 11 min Oct 11, 2016 From [![PRI (Opens in new window)](https://media.wnyc.org/i/0/15/l/99/1/PRI_logo_blk_horiz.png)](http://www.pri.org/) and [![WNYC (Opens in new window)](https://media.wnyc.org/i/0/15/l/99/1/wnyc-logo.png)](http://www.wnyc.org/) # Post a Comment # The Takeaway The Takeaway was a national daily news show from WNYC, PRX and WGBH that aired for 15 years on public radio. Produced by [GBH](http://www.wgbh.org/), [PRX](http://www.prx.org/) and [WNYC Studios](https://www.wnycstudios.org/). Subscribe to the podcast ▾ # Document Footer ## WQXR - [Music Playlists](https://www.wqxr.org/playlist-daily "Playlists") - [WQXR Schedule](https://www.wqxr.org/schedule/ "Schedule") - [Programs](https://www.wqxr.org/shows "Programs") - [Hosts](https://www.wqxr.org/hosts/ "Hosts") - [Podcasts](https://www.wqxr.org/shows/wqxr-podcasts/ "Podcasts") - [Videos](https://www.youtube.com/wqxrclassical "Videos") - [WQXR Features](https://www.wqxr.org/articles/wqxr-features "WQXR Features") - [Operavore](https://www.wqxr.org/blogs/operavore/ "Operavore") - [WQXR Archives](https://www.wnyc.org/series/wqxr-archives "WQXR Archives") ## New Sounds - [Homepage](http://www.newsounds.org/ "Homepage") - [Playlists](https://www.newsounds.org/livestream "Playlists") - [On-Demand Concerts](https://www.wqxr.org/shows/newyorknow/ "On-Demand Concerts") - [Soundcheck Podcast](https://www.newsounds.org/shows/soundcheck "Soundcheck Podcast") - [About New Sounds](http://www.newsounds.org/about "About New Sounds") ## About Us - [Mobile Apps](https://www.wqxr.org/mobile-apps/ "Mobile Apps") - [Support Us](https://www.nypublicradio.org/support/ "Support Us") - [About WQXR](https://www.wqxr.org/about/ "About WQXR") - [Audio Help](https://www.wqxr.org/audio/help-new-player/ "Audio Help") - [Contact Us](https://www.wqxr.org/contact/ "Contact Us") - [Online Member Center](https://pledge.wqxr.org/user/email-link "Member Center") - [Jobs](https://nypublicradio.org/careers/ "Jobs") - [Diversity (DEI)](https://www.nypublicradio.org/diversity-dei-overview/ "Diversity (DEI)") - [Sponsorship](https://www.wqxr.org/underwriting/ "Sponsorship") - [Community Advisory Board](http://www.wqxr.org/outreach/cab/ "Community Advisory Board") - [NY Public Radio](http://nypublicradio.org/ "NY Public Radio") - [Giveaway Rules](https://www.wqxr.org/articles/wqxr-and-q2-music-contest-rules/ "Giveaway Rules") ## Connect - [Facebook](http://www.facebook.com/WQXRClassical "Facebook") - [Twitter](http://www.twitter.com/WQXR "Twitter") - [Instagram](https://www.instagram.com/wqxr_classical/ "Instagram") - [YouTube](http://www.youtube.com/user/WQXRClassical "YouTube") - [RSS](https://www.wqxr.org/feeds/all/ "RSS") © 2026 New York Public Radio All Rights Reserved. WQXR is supported by - [Terms of Use](https://www.wqxr.org/terms/ "Terms of Use") - [Privacy](https://www.wqxr.org/privacy/ "Privacy") - [Accessibility](https://media.wnyc.org/media/resources/2022/May/06/accessibility_policy_5.6.22.pdf "Accessibility") - [WQXR FCC Public File](https://publicfiles.fcc.gov/fm-profile/wqxr-fm "WQXR FCC Public File") - [EEO Report](https://www.wnyc.org/resources/912769/fcc_eeo_public_file_report.pdf "EEO Report")
Readable Markdown	The Takeaway was a national daily news show from WNYC, PRX and WGBH that aired for 15 years on public radio. Produced by [GBH](http://www.wgbh.org/), [PRX](http://www.prx.org/) and [WNYC Studios](https://www.wnycstudios.org/).
Shard	16 (laksa)
Root Hash	779283536040568016
Unparsed URL	org,wqxr!www,/story/trump-billy-bush-and-problems-male-language s443