🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 36 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 10823737302391506200whattowear.bike312026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1785775337992088940033.bingo472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 5245875805485188000188bet.bio402026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 105548114891345232001bandar.bio162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 625614141676666900088pp.bio452026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 17820827529817756600biodinatura.bio832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14717633710687067800bizbros.bio392026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16757068765568999800cursosonline.bio992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5801010015199722800doppl.bio142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6851018041186989000dsc.bio452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 375750183392030200eclzz.bio512026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8942213835078345000flexdigital.bio252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 362620085794351000ggl.bio552026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:826 11248630404779881000glytch.bio52026-03-18 05:55:242026-03-18 05:55:248262026-03-18 05:55:24laksa000
SPAM:1000 1163001872358581000gozo78.bio52026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 13727712174678921600guild.bio82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5892762086091049400heilkraft.bio472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15092941760918406600houloul-herbalance.bio332026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 5464400116100670400indoorcam.bio522026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 14947341677545616600jovian.bio832026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:700 9064657642304713200jsmith.bio662026-03-31 17:25:042026-03-31 17:25:047002026-03-31 17:25:04laksa000
SPAM:1000 6974546294104752000kikivhyce.bio602026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:0 7679656591558019200kitsune.bio962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1020339539417152200linktech.bio612026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 16497044424361650400mmf.bio522026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2226256973736521800monocle.bio92026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15854460886865686600oxymel.bio332026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4875974993546415800safeplaceproducts.bio792026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3901162112700157000silo.bio852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5288680960312410400sirajulislamlipon.bio522026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14859716569967133000slagerij.bio652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13058354147188183200supersigns.bio162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12866003961777966000superstarnetworks.bio302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:937 4884868935773874000theimpactvibehq.bio702026-03-18 05:55:242026-04-13 09:10:169372026-04-13 09:10:16laksa000
SPAM:0 6200213945800033800trae.bio692026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1185733259879980400ufa1688.bio22026-02-17 04:56:342026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 9709278763368721600walnut.bio82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16483308370076986400wunderkind.bio322026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15788335502017380200zapi.bio12026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6097529016162660000zola.bio02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1108194273197016160039861.biz82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8141295432608194200922bet.biz712026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 837225124311721520099ltd.biz762026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16258252725550204200a-zelectric.biz212026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 1184009348811649800aagmaals.biz492026-02-03 06:27:312026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:0 5544363083754168800abart.biz442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4550263237721603400ablastream.biz172026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2570132587215269600aboutdog.biz482026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15308942372946508800abraxa.biz442026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8686957254111495200absolutepower.biz762026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 16910410052164232000agass.biz602026-01-06 03:09:552026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:980 16686585661031582200ageofegypt.biz112026-01-06 03:09:552026-04-13 09:10:169802026-04-13 09:10:16laksa000
SPAM:0 7048671884355885600aifi.biz282026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6399273738883431000aimsupply.biz552026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 12604231926806115400airdoctor.biz772026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:933 6909185662412908200al-amoudi.biz412026-01-06 03:09:552026-04-13 09:10:169332026-04-13 09:10:16laksa000
SPAM:1000 16990189637101536000aniol.biz802026-03-24 07:10:182026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:860 4764749925225949600annuaire-des-jeux.biz482026-01-13 07:00:512026-04-13 09:10:168602026-04-13 09:10:16laksa000
SPAM:0 17349791432435748200ap4.biz412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9099060734487585200apskaita.biz262026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:814 4562378789390317400aquascope.biz872026-03-18 05:55:242026-04-13 09:10:168142026-04-13 09:10:16laksa000
SPAM:0 532236194303822000ariesweb.biz102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:909 1353958303127782000arschficken-analficken.biz102026-01-06 03:09:552026-03-31 17:25:049092026-03-31 17:25:04laksa000
SPAM:0 4243024284904243200arshin.biz162026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11112427433505431800arteworks.biz592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2271091710783491400asianews.biz572026-02-03 06:27:312026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 4233280206758320400back-door.biz22026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9912244634148706800batemanarchitects.biz342026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14931323672108619600bedrijfsrecherche.biz982026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:960 15719930341847154000belor.biz702026-01-13 07:00:512026-04-13 09:10:169602026-04-13 09:10:16laksa000
SPAM:1000 7591562939311406800bhatoy.biz342026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 15923738768587093800bhsgloballtd.biz692026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3226209322961670200biblecode.biz512026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 14606407702764202000bigdataroom.biz102026-01-06 03:09:552026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 4361304763391442600biosculpture.biz132026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:727 15634689270121404000bipko.biz202026-01-06 03:09:552026-03-31 17:25:047272026-03-31 17:25:04laksa000
SPAM:0 2664785466464440800bitcoinfr.biz42026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5391828747367173200bizpower.biz662026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:731 2934006811962165400bizva.biz272026-01-06 03:09:552026-04-13 09:10:167312026-04-13 09:10:16laksa000
SPAM:700 5403135021115266400bloomingdalelocksmiths.biz322026-01-06 03:09:552026-03-31 17:25:047002026-03-31 17:25:04laksa000
SPAM:0 14615587312380217600blueskyfinancial.biz882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 15667801541282242600bofatis.biz132026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 15198496214224520200bolaklik.biz12026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 2304259579386476000borgward.biz802026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16419138444166953200boric-acid.biz662026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14891345200182985400borovikov.biz272026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4284593100984696800bringo.biz842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 13411435622365449200businessoma.biz462026-01-06 03:09:552026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 15841090046078998600byfleet.biz932026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:888 9338204898892437400cacko.biz872026-03-18 05:55:242026-04-13 09:10:168882026-04-13 09:10:16laksa000
SPAM:700 11825799798038704800cadobongdaonline.biz242026-01-06 03:09:552026-03-24 07:10:187002026-03-24 07:10:18laksa000
SPAM:1000 14467601557337944200calon4dpedia.biz212026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 17682790359821050400cam2.biz522026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 3466236960693148800casinostar.biz442026-01-06 03:09:552026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:750 5386965230802590000catten.biz502026-01-06 03:09:552026-04-13 09:10:167502026-04-13 09:10:16laksa000
SPAM:0 10966110502907644200cdnbr.biz212026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4310316161582484600cedarroofing.biz232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 17329143008939093400cheaptyres.biz672026-02-03 06:27:312026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 14053623858558298600cinta855.biz932026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 3487999560021146800cinta88.biz342026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))