🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 139,578
Showing: Page 3 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 80154148392416900034.121.54.161452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1179522483707863260034.200.209.106632026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1077261597116449020034.200.233.115512026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 837574422755636920034.232.119.79462026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 283683168778542340035.222.88.100172026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 283683168778542340035.222.88.100172026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 65999732458723180035.227.45.16592026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 814414315362003180035.228.89.212592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 320285304816012560035.244.213.42282026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 408402770687966460036.69.132.21232026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 408402770687966460036.69.132.21232026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 1284090368656669700038.47.213.69852026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 1283781790452214280038.6.57.35142026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:842 1200678198361107760038.63.80.108882026-01-13 07:00:512026-03-31 17:25:048422026-03-31 17:25:04laksa000
SPAM:1000 1200678198361107760038.63.80.108882026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 570459983092334440038.63.88.244222026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 448730387822699220039.103.203.141612026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1206153306568947060039.105.3.134532026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 162338037333424980039.106.200.27492026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 290161156305614860043.242.215.24432026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 543526558188956560043.246.216.171282026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 543526558188956560043.246.216.171282026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 1383105651281448100044.204.104.14752026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 1763695696416959740045.157.5.46872026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 684176771352716360045.204.212.165182026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1523001964632001900045.63.48.66952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1346475524458478080045.76.149.17142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 1626777672696098900045.76.186.174452026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 1626777672696098900045.76.186.174452026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 253500416262156300045.79.100.153152026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 1353519407088705540046.101.81.230772026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 772339431923396160046.226.178.8682026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 772339431923396160046.226.178.8682026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 93466385205777840047.110.40.21922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 958781373365463060047.122.116.46532026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 612561194890123300047.206.147.45652026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 330607041932622080047.94.139.18742026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 753158220690326100049.65.0.17752026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 101020485947665328005.10.9.4642026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6522801834519666005.135.8.95332026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 123708569540188096005.252.52.238482026-01-06 03:09:552026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:833 260792533461379100051.79.168.128552026-01-06 03:09:552026-03-31 17:25:048332026-03-31 17:25:04laksa000
SPAM:900 260792533461379100051.79.168.128552026-04-13 09:10:162026-04-13 09:10:169002026-04-13 09:10:16laksa000
SPAM:0 96430439101541400051.81.64.174702026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1191875628843109040052.211.230.36522026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 516786624552327800052.27.245.17902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:980 186600058285291360052.67.219.102682026-03-18 05:55:242026-03-31 17:25:049802026-03-31 17:25:04laksa000
SPAM:983 186600058285291360052.67.219.102682026-04-13 09:10:162026-04-13 09:10:169832026-04-13 09:10:16laksa000
SPAM:0 906182974527453220054.179.171.247612026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 951354621731836580054.216.239.152292026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 1304472283978937940054.225.68.192972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 166412530414386600054.245.171.170302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 617155368268682740054.251.212.246372026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 974528321493020500054.255.61.146252026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 53458588602054620059.120.9.61312026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 571722754244108800061.109.255.34402026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:811 602637904570847520061.187.64.115762026-01-06 03:09:552026-03-31 17:25:048112026-03-31 17:25:04laksa000
SPAM:697 602637904570847520061.187.64.115762026-04-13 09:10:162026-04-13 09:10:166972026-04-13 09:10:16laksa000
SPAM:1000 1267408654223168720061.31.226.228362026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 1267408654223168720061.31.226.228362026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 487328828714005180062.149.243.156592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1679804404033370280062.204.161.54142026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:977 754760830202842040062.76.169.922026-04-13 09:10:162026-04-13 09:10:169772026-04-13 09:10:16laksa000
SPAM:0 630678901588973360067.199.19.45682026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 1453272470746566740068.183.2.174372026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 224945489605144180068.183.233.14992026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1249536894425555040068.183.235.108522026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1781206245284127380069.164.192.211692026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1626232848734651300069.57.162.35652026-01-06 03:09:552026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 942350874966875720074.125.206.106862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1709780752705849840074.125.21.97922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1098851718330043180074.208.156.121592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1708646208243056140079.123.134.5772026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 1708646208243056140079.123.134.5772026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 405717404276536840079.133.56.246422026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 19763126543892612008.148.6.7162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 36673843756301884008.209.96.245422026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1722434598472415720080.72.35.4862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 305449200151829040082.65.151.187522026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:705 911650284299217400083.212.169.21702026-01-06 03:09:552026-03-31 17:25:047052026-03-31 17:25:04laksa000
SPAM:823 911650284299217400083.212.169.21702026-04-13 09:10:162026-04-13 09:10:168232026-04-13 09:10:16laksa000
SPAM:0 1748227773501911580086.121.159.16792026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 722340933057846760086.61.187.197382026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 867160926531077560087.120.253.11782026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:838 419193761104716880088.198.122.255442026-01-13 07:00:512026-03-31 17:25:048382026-03-31 17:25:04laksa000
SPAM:0 1511868877412945020091.121.219.80512026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 641542758689774620091.121.224.192312026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 1108850083677617500094.177.178.86752026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1810747535607568840094.182.146.186422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1458358005036648500094.75.102.110252026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 1493327686507887480095.169.181.145742026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 598789108650255400avenge.ac772026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 15439202529894133600boh.ac682026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1518799224302909600crichd.ac482026-01-13 07:00:512026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 13765444506668113000cultm.ac652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3780583860925770000dynatr.ac502026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6736596093296600ludus.ac832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10311671205502387400mail.ac372026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 565510974478946600nott.ac332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1535405636319074400pobreflix.ac722026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))