🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 34 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 16047019625439249400webilio.be472026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17141668480858532200webpool.be612026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:1000 4520976326431168000websitegegevens.be402026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 15993781923352486000weddingphotography.be302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12538519185796664400westkapelle.be222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12488336102148428400whensummerends.be422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3787187868151204200wijnproever.be212026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2029895276385239200winnys.be962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17605316078891366600wonen-tuin.be332026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 7494793093433775800woneninrubano.be792026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15904900247248782600woongroothandel.be132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:727 12728691004642843200worldofweejee.be162026-01-06 03:09:552026-04-13 09:10:167272026-04-13 09:10:16laksa000
SPAM:0 9731955767843807000x-trempc.be352026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1337733140141671800xenus.be592026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 6586396101702393200yamaha-season-starters.be662026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4190643882811341000yannickp.be52026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 18157602402609433600yogadaybw.be682026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 464156797543243800yorrick.be192026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8486662662406131000yourteamassessment.be552026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1636238465584521800zaitoon.be92026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:909 234237670655268000zeparah.be402026-01-06 03:09:552026-03-24 07:10:189092026-03-24 07:10:18laksa000
SPAM:0 7058661581588486600zeth.be332026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 12817826571108799000zilvermeeuw.be952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17326691332867593800zinehappening.be692026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17261263888578791400zoetgedacht.be572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10003244498552323800zorgenfarma.be192026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17504443959425272800zuivelhubrechts.be642026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:687 12699753622597402600zvz.be132026-03-24 07:10:182026-03-24 07:10:186872026-03-24 07:10:18laksa000
SPAM:0 996252231285609200zwcad.be462026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 172463482357967636007ball.beauty182026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 14315459465401508600arena1mega.beauty432026-01-14 03:13:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 3440438996029078400djiqfuclzyp.beauty922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9209276418876976000ijatlcpxnky.beauty802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:950 10001158644025804400legalanalporns.beauty222026-03-18 05:55:242026-03-18 05:55:249502026-03-18 05:55:24laksa000
SPAM:0 16260544857301577000lzhxkuocsfj.beauty852026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:800 13342267483174532000majesticweddingsgala.beauty602026-03-18 05:55:242026-03-18 05:55:248002026-03-18 05:55:24laksa000
SPAM:1000 1907480171979031200maukaiko.beauty562026-03-18 05:55:242026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:1000 3842846420667859800pokerdomq.beauty992026-02-17 04:56:342026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 2912505784652154600stream.beauty732026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 8725216298762360400thabet.beauty22026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:660 15201573680017065000adventuresinhomebrewing.beer252026-04-13 09:10:162026-04-13 09:10:166602026-04-13 09:10:16laksa000
SPAM:0 16748859174592794200brewmonkey.beer712026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 15955578229879747400fb68.beer372026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:885 8748103892095478400tl.beer922026-04-13 09:10:162026-04-13 09:10:168852026-04-13 09:10:16laksa000
SPAM:0 45108451279060600twistedwheel.beer32026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 2218124391256022000aagmaal.berlin102026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 17220080228753422400aufraeumen.berlin122026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 5407057215913620600bad-fugenlos.berlin32026-01-06 03:09:552026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:714 9597190837790911400fussreflex-hypnose.berlin572026-01-13 07:00:512026-03-24 07:10:187142026-03-24 07:10:18laksa000
SPAM:0 15072502239084213400gameon.berlin672026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5598777221986235000grw.berlin752026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 18301630362884427800hausmann-friends.berlin392026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 11074787245990002200kapelle.berlin112026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15746138991602740400knäckezeit.berlin22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14524152018326362600money.berlin132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9178179529432565000praxismanagerin.berlin252026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16768537880762408800roundabout.berlin442026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 11620735564095337200sexperience.berlin862026-01-13 07:00:512026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 17074249245011607400sine.berlin372026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17859708415672193000spleen.berlin652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:900 7374116985743406000transfer24.berlin302026-01-06 03:09:552026-03-31 17:25:049002026-03-31 17:25:04laksa000
SPAM:0 17348179199187561400casino-online-royal.best72026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 8588773769121360200cima4u.best12026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 18330491321069491200foodies.best562026-01-13 07:00:512026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:1000 3665137893808301400link-rrtoto.best72026-03-18 05:55:242026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 17936889524764628800magatrump.best442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16818874834525358000minioc.best902026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 9481486695002303400oopose.best172026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:880 12920957651966417600ozempic.best882026-01-13 07:00:512026-04-13 09:10:168802026-04-13 09:10:16laksa000
SPAM:0 9781672212190822800sewingmachines.best142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:860 347034310634506200suinks.best312026-01-06 03:09:552026-04-13 09:10:168602026-04-13 09:10:16laksa000
SPAM:0 6820971346312699200taraftariumgole.best962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1685706977959023400thermoprotect.best172026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15531726243606572400turbowins.best622026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 9229513008199387600veo4ai.best382026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 9365244337586993000versatile.best652026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 48976555754535516001ee.bet582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 120788647163425194001xbet-thai.bet972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4281160317519160030game.bet582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:833 13951927983982878400420.bet922026-01-13 07:00:512026-04-13 09:10:168332026-04-13 09:10:16laksa000
SPAM:1000 585083568490298006878bet.bet492026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 11060846967344511400850.bet572026-02-17 04:56:342026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 14117447637171250000979vn.bet502026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 446423995218587380099maxxxbett.bet692026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 15424649526904557800allufa.bet892026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 17431994679084783400ampm777.bet172026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 337955678162764600arbi.bet232026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 576091469512553200bc79.bet662026-02-03 06:27:312026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:1000 1342674947232850000benjaminsbet.bet502026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 7564031047403802800betmanta.bet142026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 6216714156199055600bettobet.bet782026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7734162710954008800bmw55.bet442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18321981118475817200cadobongda.bet862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 12170471355378506400chanlebank.bet322026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 15937287640903160000chienke88.bet02026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:818 14199894312295587400doubleu.bet372026-01-06 03:09:552026-04-13 09:10:168182026-04-13 09:10:16laksa000
SPAM:937 11688705219682598400filmyhit.bet922026-01-13 07:00:512026-04-13 09:10:169372026-04-13 09:10:16laksa000
SPAM:900 12871034441412440600godsofplinko.bet32026-03-18 05:55:242026-03-24 07:10:189002026-03-24 07:10:18laksa000
SPAM:980 18021700663957329400hacklink.bet472026-02-03 06:27:312026-04-13 09:10:169802026-04-13 09:10:16laksa000
SPAM:0 568869748880955800hattrickbet.bet792026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))