🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 4 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:909 15023537256152119800atmtexchem.ae992026-03-24 07:10:182026-03-24 07:10:189092026-03-24 07:10:18laksa000
SPAM:0 3245335675842777400ayaaninternational.ae872026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 12808840807003433200babyamore.ae662026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6136552284749263400bizgroup.ae172026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15526434475071389200brandbuild.ae462026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 602623912783202800brooklyngm.ae142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:692 5709077952276037400celoraby.ae872026-03-18 05:55:242026-03-18 05:55:246922026-03-18 05:55:24laksa000
SPAM:692 6478282180714775000century-gulf.ae752026-01-06 03:09:552026-03-18 05:55:246922026-03-18 05:55:24laksa000
SPAM:0 4169410763782788000cheetah.ae402026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9113531252237978000classicmarine.ae902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 16152286753297804800cleverdog.ae242026-01-06 03:09:552026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 731566859884803400composites.ae172026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 17263500978579247200daf.ae362026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16139054345784958600ddc.ae932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 9176770997590607600dgate.ae382026-01-06 03:09:552026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:666 4418455524345142800drcheck.ae142026-04-13 09:10:162026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:0 130398691045834200drivesmart.ae712026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 11392291366818358800echristian.ae942026-01-13 07:00:512026-03-18 05:55:247002026-03-18 05:55:24laksa000
SPAM:0 8660618785246456200egsc.ae812026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5246901958877473400emiratesinsurance.ae672026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14526487723487289000emiratespride.ae452026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 12787642204516233800explorelife.ae692026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 6638958938036069800fnsfurnitures.ae492026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16621065334220023800gardencare.ae192026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:818 18240349574694077600gloryhomes.ae882026-01-13 07:00:512026-03-31 17:25:048182026-03-31 17:25:04laksa000
SPAM:960 10202971470820633600gogetters.ae682026-01-06 03:09:552026-04-13 09:10:169602026-04-13 09:10:16laksa000
SPAM:0 14755526833353718600hardwareshop.ae932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:920 3947316080803800200hashtagme.ae12026-01-13 07:00:512026-04-13 09:10:169202026-04-13 09:10:16laksa000
SPAM:681 1101010320907258600heerachild.ae932026-01-13 07:00:512026-04-13 09:10:166812026-04-13 09:10:16laksa000
SPAM:880 9201857025129473000housecreative.ae652026-01-06 03:09:552026-04-13 09:10:168802026-04-13 09:10:16laksa000
SPAM:0 4333708214886785200humpter.ae262026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15221528475751060800itdcctvsecurity.ae42026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4954327715173546200itravel.ae312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1305135534101004600labgrowndiamonds.ae232026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:928 17544329387056810800leadfit.ae542026-02-17 04:56:342026-04-13 09:10:169282026-04-13 09:10:16laksa000
SPAM:0 4483869081802643800matharu.ae192026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16836652225027922800mayfairinteriors.ae142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 13826654085658103800mediastore.ae192026-01-06 03:09:552026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:714 418272020563403000metrohouse.ae152026-01-13 07:00:512026-03-18 05:55:247142026-03-18 05:55:24laksa000
SPAM:1000 14962200791395296800mirkgroup.ae842026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:692 13508823414140954400mist.ae722026-01-06 03:09:552026-04-13 09:10:166922026-04-13 09:10:16laksa000
SPAM:0 11224047908296934200modernseal.ae712026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4997444154940496400mozaic.ae822026-01-13 07:00:512026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:727 6048260101007024600noorminer.ae232026-01-06 03:09:552026-03-31 17:25:047272026-03-31 17:25:04laksa000
SPAM:0 12238783437218814600ogc.ae732026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4463096186228693400paintingservice.ae672026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 13318442071867024200pawshhotel.ae212026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:700 18100592225822316000primeservices.ae802026-01-06 03:09:552026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:0 9624796867957812600procedyne.ae632026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:980 16715002641368561000rentalgenerator.ae52026-01-14 03:13:162026-04-13 09:10:169802026-04-13 09:10:16laksa000
SPAM:980 15314939763074146400royalsquad.ae322026-01-06 03:09:552026-04-13 09:10:169802026-04-13 09:10:16laksa000
SPAM:760 5761053160502292600seniorjackets.ae632026-01-06 03:09:552026-04-13 09:10:167602026-04-13 09:10:16laksa000
SPAM:0 12398822810509493600shabbat.ae682026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4598470113258902200sjpr.ae112026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 2951778635973676400skymedia.ae822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17819912146242326800smartgate.ae342026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 11825831168995438400studyinchina.ae922026-04-13 09:10:162026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:0 14097750032191711000suke.ae552026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:818 10495071937279930800tarjamah.ae542026-01-06 03:09:552026-03-24 07:10:188182026-03-24 07:10:18laksa000
SPAM:0 17607864452130895200taxaccountant.ae762026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 11320803059216583800verawellness.ae192026-03-24 07:10:182026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:0 8770472642347585800viacon.ae292026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:700 4464197794812617600victageneraltrading.ae882026-04-13 09:10:162026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:0 13620272690505020400west-gate.ae22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15201452521214217400wetrack.ae872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:981 5876882195572751400wetube.ae572026-01-06 03:09:552026-04-13 09:10:169812026-04-13 09:10:16laksa000
SPAM:0 17083955139927522600wide.ae132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12674571164188026000yourdealer.ae302026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15487288330938733000aqs.aero652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 327811631545209000hex.aero452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 215909340618952800joa.aero642026-02-10 04:07:202026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 15419506681590800600loadcontrol.aero32026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12749950361828659000pizer.aero952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11380740715069577000vog.aero852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:923 85437131601006000jamiat.gov.af302026-01-06 03:09:552026-04-13 09:10:169232026-04-13 09:10:16laksa000
SPAM:920 15510056375205751400mrmc.gov.af572026-01-06 03:09:552026-04-13 09:10:169202026-04-13 09:10:16laksa000
SPAM:0 16368648240733249200bridge.org.af462026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 446837764228564200payenda.af212026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6780953908341245000buyelekhaya.africa252026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 2528121805722883600evisas.africa182026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 14811355701216954600fric.africa732026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:857 6576162874678364800imaginet.africa242026-03-24 07:10:182026-03-31 17:25:048572026-03-31 17:25:04laksa000
SPAM:0 7517818561424221600indiefilms.africa82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:711 11566817472129416200nadeum.africa812026-02-03 06:27:312026-04-13 09:10:167112026-04-13 09:10:16laksa000
SPAM:0 15446063990692464600nesti.africa232026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 13443625233590534400paywithplay.africa722026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:881 6590992874587850000sokokuu.africa502026-01-06 03:09:552026-03-31 17:25:048812026-03-31 17:25:04laksa000
SPAM:0 9803904853631713000sumclub.africa652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:809 16747595938830118000thrivebiz.africa902026-03-31 17:25:042026-04-13 09:10:168092026-04-13 09:10:16laksa000
SPAM:760 6251395135415210400thriveconsulting.africa522026-01-06 03:09:552026-04-13 09:10:167602026-04-13 09:10:16laksa000
SPAM:0 8605015564552175600dsk.ag782026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3205284101784674400fruitful.ag722026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10885735657246775200image.ag762026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3827175622824120200jv.ag12026-01-22 02:10:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 5164857127622219800podcast.ag992026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 12359426608800579400r-zs.ag972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:928 18343215640966570200tem.ag512026-01-13 07:00:512026-04-13 09:10:169282026-04-13 09:10:16laksa000
SPAM:0 17662019360181272600vmcrop.ag632026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 13922061741387327800652713.agency392026-02-03 06:27:312026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 2999195607702202000actbold.agency102026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))