🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 24 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:750 1353145681428644800suplab.com.au242026-01-06 03:09:552026-03-24 07:10:187502026-03-24 07:10:18laksa000
SPAM:0 2664603774666208200surfcore.com.au412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6056290181795380800surrondirtbike.com.au42026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3804344912242869000sydneybowls.com.au452026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 16469459991633393000sydneyurduschool.com.au652026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 957927673833849400sydneywestspecialists.com.au472026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:727 14497455062529372800synergybusiness.com.au642026-01-06 03:09:552026-04-13 09:10:167272026-04-13 09:10:16laksa000
SPAM:0 1414420436012808000takeamex.com.au402026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6893374837430365200tarahealthcentre.com.au262026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8467129086697024000tarakanproperty.com.au202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12836520385204188800tbtcsydcity.com.au442026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 5866686660968541600tcbusinesssolutions.com.au82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13013167739996334000termite-treatment.com.au702026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11168790375433920600tetrapakkids.com.au32026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 15915892966272841200thedigitalcraftsmen.com.au62026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4037429685128991800thefirmpg.com.au592026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13490541610134260800thehalalmeat.com.au42026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12683670832628311800thehospitalitystore.com.au592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10425756605551949200thelittleredhen.com.au462026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17432707664681462800theluxurycarvault.com.au142026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7116775379195971600theorphans.com.au582026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13030773833120744000theperinatalhub.com.au202026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4666001275205040800theredbutton.com.au42026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3534084743737072200thespottedcow.com.au612026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 7997427470123705000thetaxagents.com.au252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3546631795204117000thewatercleanser.com.au852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8467793820197124200thewellnessrepublic.com.au212026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16186948036316674000thinkcollective.com.au702026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17338551066700130800thiru.com.au542026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4649893417287675000thompsonmotorbodies.com.au752026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9415248833411379600tildaone.com.au982026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15100189156213885200timelogic.com.au262026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 9222765889079223400tlewindsor.com.au172026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5535589988606040800tonydimaurobuildingmaintenance.com.au42026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10611188866484142600tonysengineering.com.au132026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2077810969444338800topwoodfloors.com.au942026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16822590513349908200tradeswomenaustralia.com.au412026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9674074801563109400trak.com.au472026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14772874314617709400tregea.com.au472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 1016364091805627200tret.com.au362026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11447637653608434200truckelectrical.com.au712026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2612055558245171600truetech.com.au582026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11768094521181101800ultrawellness.com.au92026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 2302955320740182600uncannyangler.com.au132026-01-13 07:00:512026-03-24 07:10:187002026-03-24 07:10:18laksa000
SPAM:0 6193141949502605200uniqueexpress.com.au262026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3954046868845729000universalscaffolding.com.au452026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17514490959535663400unsecuredfinanceaustralia.com.au172026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 17917318028252951600urbancommercial.com.au582026-01-06 03:09:552026-03-31 17:25:047002026-03-31 17:25:04laksa000
SPAM:0 18011500510780134000valueflowit.com.au702026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:820 4731859035318771800versace.com.au592026-04-13 09:10:162026-04-13 09:10:168202026-04-13 09:10:16laksa000
SPAM:0 2653653454928531600victoriacurtiscosmetics.com.au582026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4195530720544709000visglobal.com.au452026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 12927266447980692800visitnimbin.com.au642026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:700 14348846863617553600vrasolutions.com.au682026-03-31 17:25:042026-03-31 17:25:047002026-03-31 17:25:04laksa000
SPAM:671 4961937614507732800vulcanrepairsadelaide.com.au642026-01-06 03:09:552026-03-18 05:55:246712026-03-18 05:55:24laksa000
SPAM:0 16462194285340565800wantree.com.au292026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 9066774922070505200warill.com.au262026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2166297310923706200watertruck.com.au312026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12277756547910027800wearesynonymous.com.au392026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11299592160208828000webcetera.com.au402026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 11065238836314314800webgurus.com.au742026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 456968104599333400webkoala.com.au672026-01-13 07:00:512026-03-31 17:25:046662026-03-31 17:25:04laksa000
SPAM:0 10677725633569320600welshgroup.com.au32026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12614142401833799800westarbor.com.au992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13953843979242846600westcoastcustoms.com.au332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3208053239616967200westperthcarremovals.com.au362026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9211496171640948000westviewglass.com.au402026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2367467405833379000winnlane.com.au952026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14907320039006640400wixaglo.com.au22026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 569373407818804800woodbridge-lawyers.com.au242026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 921673243202684600worthitloans.com.au232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11412118921126628800wynmusic.com.au442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3015227243126933400wynnummanlysailingclub.com.au672026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13404542836607145600xeroxbus.com.au282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13482423741701784000xsnanolubricants.com.au202026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17105131171203916400yandoit.com.au822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 18399018997462654600yappy.com.au732026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10599839783441064000yarramarinaservices.com.au202026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6082777937209459600yogawithgili.com.au982026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14975649707059123000yourlifeassist.com.au152026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 6900675371666215600zealpersonnel.com.au782026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 5729879263528072600zenacupuncture.com.au632026-01-06 03:09:552026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 7200746638045559800zoltan.com.au992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2430218899274350400compucon.au522026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17812633422128902200danslocalplumbing.au112026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2427478946469371400austin.edu.au572026-02-17 04:56:342026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 424842673176110000macintyre-h.schools.nsw.edu.au502026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3393983815324207200westerncentral.edu.au362026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:714 11730053177777286400emergencycarpetcleaningwhittlesea.au322026-01-13 07:00:512026-03-31 17:25:047142026-03-31 17:25:04laksa000
SPAM:0 7757430234174528200fishingline.au412026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 5039120622639364600bacons.id.au232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8882982732762499200bevins.id.au962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12961468583815283400her.id.au172026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 5572669186214507400ton.id.au372026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9305802080419211800industrialdigital.au592026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6886543431994284400insurancebroker.au222026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11577436862616597400itx365.au872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8716230652655155800kbuncarriages.au792026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10279066218621253200keal.au662026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 15496290639372016400lilpiggy.au822026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))