🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 21 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 1470232799458767200geelonglegal.com.au362026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:806 17507021628294639200geniesafetyhub.com.au962026-03-18 05:55:242026-04-13 09:10:168062026-04-13 09:10:16laksa000
SPAM:0 7992999175141721600getcarloans.com.au82026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 18222899410089304800getmejob.com.au242026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15295310183688908400glassninja.com.au422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 17284675681659210200glenmorepark.com.au512026-01-06 03:09:552026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:760 2736837441847572400gloriadieu.com.au622026-03-18 05:55:242026-04-13 09:10:167602026-04-13 09:10:16laksa000
SPAM:0 17798678412193831600gncs.com.au582026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14949745590480437000goldenasset.com.au852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10998410510653673400goldfieldscanvas.com.au672026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12007426435612181200gottalovethebowlo.com.au62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12273943138782474200gotyadog.com.au712026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16306207950034177800granichpartners.com.au892026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5219667327355580000greatmusic.com.au02026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 12858583434174666400greyhoundrecorder.com.au322026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15391921510280165000gtana.com.au252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17393923288568914000hairdresserswebsitesamples.com.au702026-01-14 03:13:162026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 9943099772723761000hames.com.au52026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 710103204121447400hamiltonpsychology.com.au372026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 512844503247211800hampersacrossmelbourne.com.au592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13139312016193884800handsuptuition.com.au242026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 10942785960512816800haydens.com.au842026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 11771422620473153200heal2021.com.au662026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 7363949662784570000heathmckinley.com.au502026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9644346207473501400henryegloff.com.au72026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 5210440147390206800herbie.com.au342026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 15993159832171605800heynemechanicalsolutions.com.au292026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15080610518482395000himachalionline.com.au752026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3312912843493011200honeyseedandco.com.au562026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14922601053180040600hoteldelatite.com.au32026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11556520838458884800housemart.com.au242026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 708362153583503600howtobuildahouse.com.au182026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 7976085864906362600hubofhealth.com.au132026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5191973191590516800humira.com.au842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7579688893806549200huntleylaw.com.au462026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6644371050899724600hyperbole.com.au232026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:880 11775266206866930800i2software.com.au542026-01-06 03:09:552026-04-13 09:10:168802026-04-13 09:10:16laksa000
SPAM:0 69354551969301400icanapp.com.au72026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10658110792452850800iciem2021.com.au542026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17940534080750204400imonitor.com.au222026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 10367460991307239000impaktcare.com.au952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 7668005336609144200impi.com.au212026-03-18 05:55:242026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 11091190969810696400independencestudios.com.au822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12629946748654195200inspirationalworkplaces.com.au762026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13425687165184300000inspire9.com.au02026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8298591479569423000insurancefordrones.com.au152026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9892509061887299600intique.com.au982026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11316522403783344000investeasy.com.au202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9661171788438497200iopconference.com.au862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2800954603804849400isfs.com.au472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:666 5548775856057674600itguaranteed.com.au732026-04-13 09:10:162026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:1000 9631519841020665600itile.com.au282026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 4610692796483748200iwinseo.com.au412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:720 15576207394758469400iwrn2025.com.au472026-02-10 04:07:202026-04-13 09:10:167202026-04-13 09:10:16laksa000
SPAM:900 1062424292566566400jacksonslanding.com.au322026-01-13 07:00:512026-03-24 07:10:189002026-03-24 07:10:18laksa000
SPAM:0 7267471755795081600jadehodson.com.au82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18062031772683881000jaderesorts.com.au52026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:750 8646836245866324000jameswatson.com.au202026-02-10 04:07:202026-03-18 05:55:247502026-03-18 05:55:24laksa000
SPAM:0 13291821106472628800janayakarlocinaturopath.com.au442026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15962690083428253800janusderma.com.au692026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10998827644249529000japingka.com.au452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12224372748080397000jasons.com.au852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17950386862008814000jcmotors.com.au702026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15505693604610110800jdndesigns.com.au542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:692 2128784514843131800jecscleaningservices.com.au592026-01-06 03:09:552026-03-24 07:10:186922026-03-24 07:10:18laksa000
SPAM:0 3535711138790263200jetpik.com.au162026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15051869259140315000jimmypatch.com.au752026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:833 15640489708919099800jobbo.com.au992026-01-13 07:00:512026-04-13 09:10:168332026-04-13 09:10:16laksa000
SPAM:0 8241650773607428400jodileefoundation.com.au422026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15246612717784083600joinsmartcart.com.au182026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11398757807852688800jpre.com.au442026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2575551059782506800juliesembroidery.com.au342026-01-14 03:13:162026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:684 14246508443361968000kalazichsmith.com.au402026-01-06 03:09:552026-03-24 07:10:186842026-03-24 07:10:18laksa000
SPAM:0 1311280736827556600karinourish.com.au832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15444689056774621800kastex.com.au92026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4306746621875246600kea.com.au332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9811973466541307800kenmillstoyotasunshinecoast.com.au392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5897605843509098800kenney.com.au942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11034228533237022200kerryobrienpublicity.com.au112026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3511389299056325600khaconstructions.com.au282026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17698680653670245400kilnservices.com.au272026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3593203482563384800kiraana.com.au242026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7080651909674706200kismetbestseller.com.au312026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:800 10884861231980159200klevasharp.com.au962026-01-13 07:00:512026-03-24 07:10:188002026-03-24 07:10:18laksa000
SPAM:0 14148284806469531400kmtdrainage.com.au572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:651 3072145584560829800knbspecialists.com.au492026-03-31 17:25:042026-03-31 17:25:046512026-03-31 17:25:04laksa000
SPAM:0 15934557273578964600krulisresidential.com.au232026-01-14 03:13:162026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 4209180802729071200ksrautobody.com.au562026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2572300058105538200kurnellhire.com.au912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17916984579834164600lakeshorelodge.com.au232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8698000264363685400langparkmedicalcentre.com.au272026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 17353823161715035000launcestoncup.com.au752026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12650588264840548000lawyersperth.com.au402026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:785 9061836895450166000leadx.com.au302026-03-31 17:25:042026-03-31 17:25:047852026-03-31 17:25:04laksa000
SPAM:0 6298050843516090600led-vision.com.au532026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10855701662963794000ledartsigns.com.au702026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2495767631535059400lekallawyers.com.au972026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 10841991660824164600limageskincare.com.au232026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 7165736027052686600limohireperthwa.com.au332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5215876198537322000limotransfers.com.au102026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))