🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 19 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 18213142344291092800agencieplus.com.au642026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 8186187022756715800agturf.com.au792026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:782 7206075795556732000airsidecars.com.au602026-01-06 03:09:552026-04-13 09:10:167822026-04-13 09:10:16laksa000
SPAM:0 2094988030437072400akj.com.au622026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10445438279025679200alaba.com.au962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:823 695561034760417000alamsg.com.au852026-01-13 07:00:512026-04-13 09:10:168232026-04-13 09:10:16laksa000
SPAM:0 2778654051248548600alandm.com.au432026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11073447867515759800alencont.com.au992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8955146061087181000alexanderhousalas.com.au52026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 12898861565417677000alisara.com.au852026-03-31 17:25:042026-03-31 17:25:047002026-03-31 17:25:04laksa000
SPAM:0 2075600917329509600alleasing.com.au482026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:833 10084403593676533600allpoolrenovationsandresurfacing.com.au682026-03-18 05:55:242026-03-18 05:55:248332026-03-18 05:55:24laksa000
SPAM:0 15718391609075090000alssolar.com.au502026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3381907785706474600ambercreative.com.au732026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:681 10524174180202213400appropriatehealth.com.au672026-01-14 03:13:162026-04-13 09:10:166812026-04-13 09:10:16laksa000
SPAM:0 14469878737789063200aquacote.com.au162026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17503043725849775200aquafiori.com.au762026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16004150016684450800aquamasterplumbers.com.au542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10508938684469438600artisticsolutionsgroup.com.au932026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 2314162871614685400aspirecloud.com.au272026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:894 2665461011967838400asquith.com.au922026-01-13 07:00:512026-04-13 09:10:168942026-04-13 09:10:16laksa000
SPAM:0 9829761852875164000atcm.com.au202026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3508254011971103200audiovisualsolutions.com.au162026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:900 17916028794128019000auinpet.com.au952026-01-13 07:00:512026-04-13 09:10:169002026-04-13 09:10:16laksa000
SPAM:0 15689804291862253600aumama.com.au682026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15536854656668052600auspostenterprise.com.au632026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7146746827795978400auspowerconnect.com.au922026-01-14 03:13:162026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15172263865146480000austore.com.au02026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10121225536536987200australiancpe.com.au362026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6719793603339858000australiantraveldirectory.com.au902026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4632777861002443200autosports.com.au162026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7332554086085445600awbbearings.com.au282026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 13256095289562874800azay.com.au742026-01-06 03:09:552026-03-24 07:10:186662026-03-24 07:10:18laksa000
SPAM:0 16753498411856096600azzs.com.au832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8738566603896988000bailiff-sheriffaustralia.com.au402026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16468976287612714200ballbalmandco.com.au712026-02-10 04:07:202026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 7189965539501864400ballinatouristmotel.com.au222026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 4066026543084534600banarra.com.au732026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3212181501688108600barncosales.com.au432026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 692304810271067200baskinclarkepriest.com.au362026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1335803618450526200bassa.com.au312026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4862346019490101400batley.com.au72026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11907882515353872600bclicks.com.au632026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5291247714786173200behindthefront.com.au662026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 7139349014584611600bellarinemedicalaesthetics.com.au582026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6674158343227177400berlitz.com.au872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17930131344860576200berniespainting.com.au812026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:650 12354698847148335000bestonthesunshinecoast.com.au752026-01-22 02:10:162026-03-31 17:25:046502026-03-31 17:25:04laksa000
SPAM:0 2868325687313904400bigostrees.com.au222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15698664053561505200biolab.com.au262026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12258867516232943600birdbid.com.au182026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14875339356080503200bisinellacommunitycentre.com.au162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10722051314378379800bitc.com.au992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16771334316804985800bjk.com.au292026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 612903460955185400bkbb.com.au272026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3241836434249361200blackbirdcaferestaurant.com.au62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 12360874863936693400blackburnautorepairs.com.au672026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:860 4520067916647764600blacktowndigital.com.au232026-01-06 03:09:552026-04-13 09:10:168602026-04-13 09:10:16laksa000
SPAM:0 1514397171812952800bloomandmae.com.au642026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7738086211673976800blueskyyards.com.au842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12293674008130570800boatland.com.au542026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7054193099582012400bodyfitmassage1.com.au622026-02-17 04:56:342026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 1557854844341106400bodyrebalance.com.au322026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10654437539022494200bolstermusic.com.au712026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17435899089983893000bondchester.com.au652026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12551777671047153800bosch-motorsport.com.au692026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13588356197000602800bossexcavations.com.au142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12928064274358073800botando.com.au692026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:921 10708861974232813200bpga.com.au662026-01-06 03:09:552026-04-13 09:10:169212026-04-13 09:10:16laksa000
SPAM:0 12632295766730133200bradgaynor.com.au662026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17185316738710733800brewnetwork.com.au692026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 10081482233611235600brisbanecarbrokers.com.au782026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3357157345826193400brisbanecashforcarsremoval.com.au672026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6222728720431161200broomecommercial.com.au62026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:727 13472937534375000800brownsauce.com.au42026-02-03 06:27:312026-04-13 09:10:167272026-04-13 09:10:16laksa000
SPAM:0 1124166703862331200bruinpest.com.au562026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3617037485374217000btwebs.com.au852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13226086946736932800buildingco.com.au642026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14103283851020813600bulkflowers.com.au682026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11634735337078826400butterbox.com.au322026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17008820389072323800byronbaydental.com.au192026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1535096544740360000caboolturemicrolights.com.au02026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:666 2896966876218068800calibrefinance.com.au442026-01-06 03:09:552026-03-18 05:55:246662026-03-18 05:55:24laksa000
SPAM:0 6941964347041387600calmfulbliss.com.au382026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 10100291825929837800camelotmotel.com.au892026-01-14 03:13:162026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:0 10779915686177927600canobolaskidsphysio.com.au382026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15893330620722961200canopy-care.com.au62026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10895467313252820800capitaldivide.com.au42026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 15961893714000098800carealliancespecialist.com.au942026-01-14 03:13:162026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:0 10331117082346901600careermove.com.au82026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 2233624342691161400carmagic.com.au72026-01-06 03:09:552026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:0 13379053581361262000cayasarchitects.com.au102026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10717526699194984400ccceshop.com.au222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:660 10554796672280069800chaiholdings.com.au492026-04-13 09:10:162026-04-13 09:10:166602026-04-13 09:10:16laksa000
SPAM:1000 8177131792564669000chairfix.com.au452026-01-06 03:09:552026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:0 14071654720894045000charmora.com.au252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 932575913515392200chickibabes.com.au612026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:1000 1553212358556770800chinanews.com.au542026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 12015677458720589400choclily.com.au472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16661626028438547600choicelegal.com.au382026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))