🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 2 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 16082573934938762800167.71.206.205142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13332377675647593400167.71.206.51672026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8965662566105959800167.71.220.54992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4382722325788984400167.71.221.130222026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 5165080557830656800167.99.200.108842026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 15512445685596248000167.99.68.236402026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 9181436681662440000172.104.165.22202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 14320509746803961400172.104.172.12472026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 16582959369803947000172.105.118.128352026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 9542474147660660600172.105.204.13632026-01-06 03:09:552026-03-18 05:55:247002026-03-18 05:55:24laksa000
SPAM:0 10385247123523489200172.217.1.110462026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15278287350774912200172.217.26.174612026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1179293373336220800172.234.230.9742026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8264374017010810200173.255.196.31512026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11507266233232222200174.138.28.176112026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7482637186077910400174.143.180.119522026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 8480140260728148400176.9.117.189422026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15633099873412978200178.128.105.86912026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 17744376968218098200178.128.168.68912026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 4573896744051262000178.128.52.206102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 3103782538250526600178.128.90.48332026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 12487137382161363800178.128.94.191192026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 2749816145976028600178.128.95.31432026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 3334489353868047800178.79.164.80392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1554368542986093240018.142.203.33622026-03-18 05:55:242026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 901852881967685940018.180.33.200972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1208900275912582020018.228.135.12912026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 14756194782744964000185.47.48.205202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 8889552407979517000188.166.157.62852026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 10602775715849607000188.166.198.254352026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 10419875990846860000192.3.47.23102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15273012582979021400193.6.150.22772026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 18232703087561649400194.135.92.135472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 968776681437290600194.163.149.74532026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7779235435736119400194.233.67.32972026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 13488569810150220200194.67.110.21412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:750 3580659326457539200194.67.119.99962026-01-13 07:00:512026-03-31 17:25:047502026-03-31 17:25:04laksa000
SPAM:0 14626833290354745600195.117.19.250282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12030197755208828400195.24.64.11422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13747145172063466800195.248.71.48342026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11661892841094199600196.43.162.77982026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 9590011391797981400196.43.221.1672026-01-22 02:10:162026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 8362867048940525000198.204.111.100252026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 11104969123880322800199.192.23.222142026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1030040936214297880020.2.157.76942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1627181544649228380020.46.247.101192026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5161867755809520000202.127.1.3902026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 149483844899959200202.3.77.184962026-01-22 02:10:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 3930349538415816200206.189.151.161812026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14084294314003536800206.189.40.206842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2932342652386718000206.189.44.44902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8998364065695308800206.189.90.22442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14961168827816393000206.189.92.175652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 5804189426489705000207.148.123.59252026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:928 18427217480145616600207.148.124.35832026-01-13 07:00:512026-04-13 09:10:169282026-04-13 09:10:16laksa000
SPAM:0 15509400086780191800207.148.248.157592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:857 4622078641885300000209.172.60.6802026-01-06 03:09:552026-04-13 09:10:168572026-04-13 09:10:16laksa000
SPAM:1000 703491389635818000209.38.26.195902026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 6988248694160600400209.38.83.20322026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1068419936391291400209.97.168.89572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14737877154318829600210.71.121.211482026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15984532562508098000210.71.66.12902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6400783624961370400210.76.80.148522026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 13989918187594282800212.2.217.115142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17709797267836365200212.83.147.29262026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17868961521823805600216.58.207.234282026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4442512683657084003.0.40.5422026-02-03 06:27:312026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:814 86888633145032736003.224.39.218682026-01-06 03:09:552026-03-31 17:25:048142026-03-31 17:25:04laksa000
SPAM:0 137445750561310508003.228.200.123542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 148781194308451708003.6.0.16542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 133084891960425024003.76.171.232122026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 81988839005286966003.95.97.84832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1203968439039022020031.14.238.8812026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 80154148392416900034.121.54.161452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1179522483707863260034.200.209.106632026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1077261597116449020034.200.233.115512026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 837574422755636920034.232.119.79462026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 283683168778542340035.222.88.100172026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 65999732458723180035.227.45.16592026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 814414315362003180035.228.89.212592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 320285304816012560035.244.213.42282026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 408402770687966460036.69.132.21232026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 1284090368656669700038.47.213.69852026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 1283781790452214280038.6.57.35142026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 1200678198361107760038.63.80.108882026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 570459983092334440038.63.88.244222026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 448730387822699220039.103.203.141612026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1206153306568947060039.105.3.134532026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 162338037333424980039.106.200.27492026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 290161156305614860043.242.215.24432026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 543526558188956560043.246.216.171282026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 1383105651281448100044.204.104.14752026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 1763695696416959740045.157.5.46872026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 684176771352716360045.204.212.165182026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1523001964632001900045.63.48.66952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1346475524458478080045.76.149.17142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 1626777672696098900045.76.186.174452026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 253500416262156300045.79.100.153152026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 1353519407088705540046.101.81.230772026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 772339431923396160046.226.178.8682026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))