🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 53 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 12089718295767802200dis.ca112026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8826027660358560800dividendinvestor.ca42026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2867461004100258000dline.ca902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5178334657466182200dlocks.ca112026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13927453331255976400dockcoveretrievers.ca822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8477437630014562200dogwatch.ca112026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10119958155161330000dollarroad.ca502026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11643113922150492800domainevirtuel.ca642026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13517452160145393600domainlink.ca682026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9308056458225032200domainsunder.ca612026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 8059039412237254600dookiespsychology.ca732026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 7730742130950485000dotsandcoms.ca252026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 15535987488860493000downsviewtravel.ca652026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2310572868480433200downtownbramptonwellness.ca662026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10965353969775664400dqrealty.ca222026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6843405067605608800draftdougford.ca442026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 59194247106157200dresscouture.ca862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18085104439923698000drrealtor.ca902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9343420489426691600dtsang.ca582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14377316618174480600dundee-pottery.ca32026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16465655422605576200dvmauto.ca812026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8259980915959849600dwellrealestategroup.ca482026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 334503494672874400dyanshoes.ca722026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5818316963249546200easydigi.ca312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4098513717836855800ebubelaw.ca792026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16005883383321330600echoes.ca532026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4130394415050394200educatorconnect.ca712026-02-17 04:56:342026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 6976336199167531200eduquest.ca562026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17297820936708378000effortgames.ca902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10236650988677988200egraphicsgroup.ca412026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3274411217810560800ehroyalflush.ca42026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10499551473013591000elegantweddingdirectory.ca552026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7745867170303235600elyssa.ca782026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4164313853844762200empressrealestate.ca112026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 10650276119620794200emscc.ca712026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 12552787515890426400emsivictoria.ca322026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4629372239337593800emuconsultants.ca692026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13273877213227622800endlesspools.ca142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9197799440242926200enviropass.ca312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1611720151976267800equera.ca392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 739202694158699800escape-quest.ca992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18354555879705219200essendant.ca962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8648956624496198600estreak.ca932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15637765791911740200eternalfury.ca12026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11416332850728890800exact-energy.ca542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3503358030764556800expressionsmodels.ca842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:972 17879160612606205600extensionskathleen.ca282026-01-06 03:09:552026-03-24 07:10:189722026-03-24 07:10:18laksa000
SPAM:0 11001806805783824400eynads.ca222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2889992331130247400ez-cpa.ca372026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 5181536513337588800ezarri.ca442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 3243355439812912200fairtradetoronto.ca612026-01-06 03:09:552026-03-31 17:25:046662026-03-31 17:25:04laksa000
SPAM:0 375712004022710200famillesleclerc.ca512026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16702430106899631200fashionlighting.ca562026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12106572814080524800fattalk.ca242026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6692241370833742400feelingcongested.ca122026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6686559302339430800feldmanlecture.ca542026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:660 1205915283079769800festivalafropolitainnomade.ca492026-03-18 05:55:242026-04-13 09:10:166602026-04-13 09:10:16laksa000
SPAM:0 14923402263010523800fijm.ca192026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 5942532112713183800finder.ca192026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2553876573283152400finoutdoor.ca622026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6736526441418511200firstaidtrainingjunction.ca562026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1786842151162742600fishcreek.ca132026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9140096301940030200fitofan.ca512026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:692 17792884870339901600flaircheck.ca82026-01-13 07:00:512026-04-13 09:10:166922026-04-13 09:10:16laksa000
SPAM:0 18343040476807454800flawed.ca742026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12528152543384679400flexten.ca972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 6782930567604484800flyplaces.ca242026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 3226620196188915800followtheflavours.ca792026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3527130005261296600followyournose.ca832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 15051540769183429000forgespace.ca452026-03-18 05:55:242026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 13849471624274873400formafil.ca672026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 17870229324491025400forthoseabouttoshop.ca272026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4653310844761215600fortunegate.ca782026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10921010645995641200frankandguspizzamenu.ca62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:792 4057770725232207400freespirit-yoga.ca372026-04-13 09:10:162026-04-13 09:10:167922026-04-13 09:10:16laksa000
SPAM:0 11660295183854980600frenchexpress.ca32026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 12922750821356009800fritolaygamenight.ca492026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8721129495034132200fronthouse.ca612026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:666 5653350343847177200fucacycles.ca862026-02-03 06:27:312026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:700 4331041817034888400fundex.ca422026-01-13 07:00:512026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:1000 971600955300977600futurefield.ca882026-02-17 04:56:342026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 3397407242463577800fwef.ca892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 741562511976542400garagedoorrepairforterie.ca122026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16811084146270069400hepatitec.gc.ca472026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14548495122231154200gcsource.ca712026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:727 4372320490332668200geroverse.ca412026-03-18 05:55:242026-03-31 17:25:047272026-03-31 17:25:04laksa000
SPAM:0 6489210977900011200getbarricades.ca562026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:687 7393380165596022000getdetoxed.ca102026-01-06 03:09:552026-03-18 05:55:246872026-03-18 05:55:24laksa000
SPAM:0 16515018576245877000gidley.ca852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2439628447410424600giftsoflight.ca232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16078547903587632000ginoogaming.ca602026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 5407534856582051600giveopinion.ca582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2636840404184203800glava.ca192026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4712020081719469600glenbrookhomesforsale.ca482026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 2545536886882444400globalimage.ca222026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:714 10521127202021903200globefc.ca162026-01-22 02:10:162026-03-18 05:55:247142026-03-18 05:55:24laksa000
SPAM:800 13674595217152923200glutenfreeontario.ca162026-04-13 09:10:162026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:0 3012452971524622000gmhiringcamiassembly.ca102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10520344227483193800gnqc.ca692026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 18411138013811141200go-prodentim.ca62026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))