🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 22 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 7534007101650376800lmgcreative.com.au842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5922188770270948000lne.com.au402026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9056449180433290400lobros.com.au522026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15873341559481364600localdental.com.au232026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17421868014753822000locationequipment.com.au102026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18115923872886066200lokteksecurity.com.au312026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9651632075676304400losbravos.com.au222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 843711423052342000lovendeuce.com.au102026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8109369972463048000luxorahomes.com.au402026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16372264116185865600luxuryjourneysaustralia.com.au282026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 10114883934942400000madpawsdinnerbowl.com.au02026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17967638709234508800magicwandrestoration.com.au442026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3885202701170046600magpiesales.com.au332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2018040289976263000makeupbymissjane.com.au152026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18009933364564382000managedweb.com.au102026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4515689891589279000mandurahcoastalhp.com.au952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:979 12073509666832031200margaret-river-wine-tours.com.au562026-01-06 03:09:552026-04-13 09:10:169792026-04-13 09:10:16laksa000
SPAM:0 11913873051344277000marinapizzapasta.com.au852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10872898532017398800marivelit.com.au942026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 12484602752277287000mavensai.com.au352026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15788808581439966800max-geoservices.com.au342026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3095554939190137800maydan.com.au892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14756736601076455800mcloceania.com.au792026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9708301666053253000mebc.com.au652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15372975340197926800mediaproduction.com.au342026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:923 14459973368996576000meditrackgps.com.au802026-03-18 05:55:242026-03-31 17:25:049232026-03-31 17:25:04laksa000
SPAM:0 6421176036517440800meetmichelle.com.au42026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18254572281320618000megafert.com.au902026-01-13 07:00:512026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 11666846919713619800melbournecityjaguar.com.au992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14825799204814115000meloshop.com.au752026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7103824526670989600mhello.com.au482026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:863 15720674361331136600mikesitguys.com.au832026-01-13 07:00:512026-04-13 09:10:168632026-04-13 09:10:16laksa000
SPAM:0 3868440158647934400mildurapropertyadvisers.com.au722026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16827481194796761200mindfenix.com.au62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8203096069170074600mindfulresults.com.au732026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 642166631384835400mintrecords.com.au772026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3832266166148187200miraclemarriage.com.au362026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1338757581966053800mobile-car-battery-replacement-service.com.au692026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6032180588224807000mojohomestaging.com.au352026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14348499822437270000monika.com.au502026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6876772232433850200mossvalevillagecaravanpark.com.au512026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11302858141235080600mountainsigns.com.au32026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11048942992819409400moveacademy.com.au472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9289974036494618600mpowersolutions.com.au932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18399872006819594800mtd.com.au742026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 637920547694369400muckypups.com.au472026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:940 4902314057133456400mulecreative.com.au822026-01-13 07:00:512026-04-13 09:10:169402026-04-13 09:10:16laksa000
SPAM:0 9373524711194031000mumbrellaawards.com.au552026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17646306480622436000murraytomountains.com.au802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14577400931000955200musicagiovane.com.au762026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7336118978487462200mvkstudios.com.au112026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5354465520849020400mvtilingservice.com.au22026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15003304098775335600mworld.com.au782026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:653 7358931310668919600mybizfinance.com.au982026-04-13 09:10:162026-04-13 09:10:166532026-04-13 09:10:16laksa000
SPAM:0 1546192903321099400mybnbbutler.com.au972026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 4799158386855917400mybusinessmyfamily.com.au872026-01-13 07:00:512026-03-31 17:25:046662026-03-31 17:25:04laksa000
SPAM:0 4879691226031565000myhiepautomotive.com.au252026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 6709142678322355600myhrpartner.com.au782026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10626026526413912800naturallyinspiredbrushwood.com.au642026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14662717760663008600natuzzi.com.au432026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4789621376076892000newimagefencing.com.au602026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8033895021021088400nhhg.com.au422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7883108499126819000niecon.com.au952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3924324557241741800noisyones.com.au92026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15833184273713767600nomadiqueco.com.au382026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 552483259952164800northernbeachesonline.com.au242026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 10749425388536939200northmitchamclinic.com.au962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6329574995982181400norupwilson.com.au72026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6212044392147064600nudiejeans.com.au232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14411135977303512800nulookconstructions.com.au642026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8113645531138923200nutbrothers.com.au162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12611292175987401400oakshorerealty.com.au72026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9230608228854943800occc.com.au192026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 5054810441982281400occotech.com.au72026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6568319714177586600ocmsolutions.com.au332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1938447409732113400oliviawalford.com.au672026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12254541692550723600oneaidcare.com.au182026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14992129971698337000onedegreeparaplanning.com.au852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11900485273898606800oneheartstudios.com.au342026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:909 3458728215509100400onerabbitone.com.au22026-01-13 07:00:512026-04-13 09:10:169092026-04-13 09:10:16laksa000
SPAM:0 4449532889418149000onestopgroup.com.au452026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16533315260733614400oneworlddesign.com.au722026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 490915917517803200onlinebuys.com.au162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:900 6164635788654212600onlyonefootball.com.au632026-03-18 05:55:242026-04-13 09:10:169002026-04-13 09:10:16laksa000
SPAM:0 1017822447211055200onyxkitchens.com.au762026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:720 5977458737436778000opentips.com.au902026-01-13 07:00:512026-04-13 09:10:167202026-04-13 09:10:16laksa000
SPAM:0 1738424485332572200opulentsweets.com.au612026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9509378416140857600orangemoosedental.com.au882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1733225989983841800orbitnetworks.com.au92026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3070115665658665800orianawellness.com.au292026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 2848564281486001600otarc.com.au82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9938748269942395600ourpestie.com.au782026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:750 1015641778335724800paintlessdent.com.au242026-01-06 03:09:552026-04-13 09:10:167502026-04-13 09:10:16laksa000
SPAM:0 2609002112862601200palacecentral.com.au62026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:666 5814085001980626000panashemuza.com.au302026-01-06 03:09:552026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:0 15905013953909007600papertape.com.au382026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11973759454457222000park8.com.au102026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:904 4485049417310064200parthunter.com.au212026-01-06 03:09:552026-04-13 09:10:169042026-04-13 09:10:16laksa000
SPAM:0 3829367652076577200partysignssydney.com.au862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17245009501606607000pavingandlandscaping.com.au352026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))