🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 52 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 128539900124646800bensauto.ca342026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:727 4567414904900664200bestillwellness.ca212026-03-18 05:55:242026-03-18 05:55:247272026-03-18 05:55:24laksa000
SPAM:1000 5621303159369728000betfield.ca402026-03-18 05:55:242026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 6987622187969482600bhrn.ca132026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 7967294662558529800bigearls.ca492026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16100551480514023600bikeexchange.ca182026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 7931911722188531000billandersen.ca552026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 5164276190851188400biobest.ca422026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3642032699355632400bispro.ca622026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:727 12163164311105096600bizprobpm.ca832026-03-31 17:25:042026-04-13 09:10:167272026-04-13 09:10:16laksa000
SPAM:0 919299318560161000blaxters.ca52026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12405542790052620400bluecollaradventures.ca22026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1890544868202883400bodypolitic.ca172026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 16632097535990176800bonfirerestaurant.ca842026-01-13 07:00:512026-03-31 17:25:046662026-03-31 17:25:04laksa000
SPAM:904 3700136631715958200boutiquedelamaison.ca912026-03-18 05:55:242026-04-13 09:10:169042026-04-13 09:10:16laksa000
SPAM:0 16684223136928228600brandigossephotography.ca432026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 6287806893860065600brightoncrc.ca282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12580860825759422600bristoldryland.ca132026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4628168160084140800broomstickhub.ca42026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17967952665823130800brouwerclaims.ca542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16844951773487060000brushbaggy.ca02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11081573809318422600bsrxconnex.ca132026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14745107979402473000budgettraffic.ca652026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:833 14996748586288706000builtin.ca302026-01-06 03:09:552026-03-24 07:10:188332026-03-24 07:10:18laksa000
SPAM:0 12776166663983673200cabbages.ca662026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9469028091396149000cabinandcoveknits.ca452026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17905621847543227800cadenlane.ca392026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10369852012976506400cakebreak.ca322026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10177871826794072000calgaryflowerdelivery.ca602026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3898300346675421800campfortune.ca92026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7975977373244956800campusupdate.ca842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7295569206251666600can150.ca332026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:909 13553177988872037600canada-primebiome.ca882026-01-22 02:10:162026-03-24 07:10:189092026-03-24 07:10:18laksa000
SPAM:0 182763869342017000canadagoose-jackets.ca852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10229945300703795400canadianfilmday.ca772026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:880 14369643706157823200cannasearch.ca162026-01-06 03:09:552026-04-13 09:10:168802026-04-13 09:10:16laksa000
SPAM:0 10773566278302872200canterburyplaceretirement.ca612026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 5465676369858256200canucksecurity.ca812026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:692 4268323460092141800carma-canada.ca92026-03-31 17:25:042026-03-31 17:25:046922026-03-31 17:25:04laksa000
SPAM:947 11573528140902046200casinoscanadien.ca312026-01-06 03:09:552026-03-31 17:25:049472026-03-31 17:25:04laksa000
SPAM:0 15512835643357238600cciba.ca932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7018780089329531000ccsylvanlake.ca552026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6445261977179951400ccworld.ca572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:837 9012644319707147600ceosclub.ca382026-01-06 03:09:552026-04-13 09:10:168372026-04-13 09:10:16laksa000
SPAM:0 13413989280139008000cfrntv.ca402026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14808537828413887200chathamnaturopath.ca362026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17633187849584809600cheekycritterz.ca482026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 7762582872162965400cheetossponsortips.ca272026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1956584981181427200cheryllynn.ca362026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 16596409368211610600chew-that.ca532026-02-03 06:27:312026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 9695743226964199400chicmarine.ca972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15386606812900775000chiffonex.ca752026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17042141350841811400chyy.ca572026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 12724620310190987600cinenow.ca382026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16864505982273264400citcanada.ca222026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16050916283258598000cjtravel.ca902026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 5043993083053905600clevergreenpower.ca282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 5545623969702175800clinicgrow.ca792026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10190502536916613600cliniquedubijou.ca682026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6660302762719674600cloudy4.ca732026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:714 16758704112234464400clubwest.ca222026-01-06 03:09:552026-04-13 09:10:167142026-04-13 09:10:16laksa000
SPAM:0 9398275752471134600cntnrpartners.ca732026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2131273744966531600coachbus.ca582026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 12696215664865382400coastfraser.ca122026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15997861105369435600cobwfa.ca782026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13608132565979489600coldacre.ca482026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9341341165419052000colvillebay.ca602026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11164708156784423000comarie.ca152026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 6626074125112258800commissionaires-greatlakes.ca942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 2310700167062951600contestcanada.ca582026-04-13 09:10:162026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:0 5213327653479392800corgi-bet.ca642026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9729293645050929000cottageplumber.ca452026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 25196520326006000covidcloud.ca302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1071414623396665600cpelechezmoidespetits.ca282026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 9654149071097450600creativehomesanddevelopment.ca532026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15628709717707773600creditgrow.ca682026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9690728658554850200crescentmarketing.ca512026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5446296381888185400critchleyhill.ca272026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 10716597788058694200crunchbrantford.ca712026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15024499622503886000cryptolens.ca302026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14786371537930505000cspp-scpv.ca252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:800 2279705514038529000cubaplusmagazine.ca452026-01-22 02:10:162026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:0 418506363115544000cufo.ca202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14647794493136005400dahir.ca272026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 731338154469573800damianaquiles.ca692026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18186433134417068800dancephotographer.ca442026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 12318429516259522200danshier.ca112026-01-06 03:09:552026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:0 13948026717825059000davecurtis.ca952026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 14016739649776680800davidmarchant.ca42026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8918803187756966000davidworthington.ca302026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14915612378892729600davidying.ca482026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4746815650242797200dawsontrailmuseum.ca862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17193144549540649400debrachristianson.ca472026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 13559123117643412200decorpro.ca612026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1273017029295639400demant.ca972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8269829747979005000demori.ca252026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2563766737863727400designdeplume.ca372026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10829832815273221000devymarketing.ca52026-01-14 03:13:162026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 12704633918630825000dicgroup.ca252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3744201558822331400digitalmayhem.ca572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))