🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 5 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:666 13753531753554273800advancedbranding.agency692026-01-13 07:00:512026-03-24 07:10:186662026-03-24 07:10:18laksa000
SPAM:0 6382689368438357600autodigital.agency882026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 16483881444916643200b789bet.agency162026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 4120355016650819000bas.agency952026-02-03 06:27:312026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:0 13242830169444625200betheway.agency262026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:900 2321697400379916000bi.agency802026-01-13 07:00:512026-04-13 09:10:169002026-04-13 09:10:16laksa000
SPAM:1000 17413848270534897400blackmaleescort.agency872026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 9255244230642844600blaznwoman.agency232026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 4257869720461724800brandeur.agency242026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11136802696228628800bugle.agency442026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6037484103455269000championspublishing.agency452026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13342341054883933000collide.agency652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4903353216606996600danmedia.agency832026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 9553954158152117200digitell.agency862026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13766186626999013600eightytwenty.agency682026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 9219785450570961000gogirltravel.agency52026-02-17 04:56:342026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 17591433091366390600hotfoxbranding.agency532026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5439762155562720000ibuy.agency02026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10242100517659699000meyram.agency952026-02-03 06:27:312026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 920407500594177400mir.agency872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 12186970758676429600numb.agency482026-03-31 17:25:042026-03-31 17:25:046662026-03-31 17:25:04laksa000
SPAM:980 2203457337795750400ogcommunication.agency522026-03-18 05:55:242026-04-13 09:10:169802026-04-13 09:10:16laksa000
SPAM:0 7576801532916262200prodige.agency112026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16546899545027386600revvx.agency332026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:727 7390402273868577200scalp.agency862026-01-13 07:00:512026-04-13 09:10:167272026-04-13 09:10:16laksa000
SPAM:0 1951360683509859800seoppc.agency992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1428937494168715200stormy.agency762026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:800 2024323982975971800stuut.agency592026-01-06 03:09:552026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:765 4334147896091803400svsv.agency172026-02-03 06:27:312026-04-13 09:10:167652026-04-13 09:10:16laksa000
SPAM:785 12009694214111307400the2020.agency372026-01-06 03:09:552026-04-13 09:10:167852026-04-13 09:10:16laksa000
SPAM:0 17754734789983869600urweb.agency482026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12659931824631745000uve.agency252026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3153810772620363800veri.agency192026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2092170793275721400wear.agency72026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 11040940923325586400workgroup.agency322026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12326154992369992600yeboxai.agency632026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1618942461943418200yeu88.agency912026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 23371580498629808001090.ai42026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:687 4261766229079854000acrps.ai702026-01-06 03:09:552026-04-13 09:10:166872026-04-13 09:10:16laksa000
SPAM:0 1092231629202784800administration.ai242026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 9029497949415553400aidet.ai672026-01-06 03:09:552026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:0 11422101380073573400aipose.ai672026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 5439950828078047600antventure.ai382026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:909 9029926786894111400archiwum.ai572026-01-06 03:09:552026-03-31 17:25:049092026-03-31 17:25:04laksa000
SPAM:0 11500084154075566000ashby.ai302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1310394426402788200barvision.ai412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 15974293757956859000bestlink.ai952026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 5268717406842756600bgz.ai832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12195642710588934200bluekit.ai712026-01-06 03:09:552026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 5747082722545321800boardbot.ai92026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9493857945293136000c1c1.ai802026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1130370846847756200c2pa.ai812026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11855092408731285600calove.ai282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17817216736368730600capta.ai532026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9170034004100040600cardamore.ai32026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 13041456133211133000cdb.ai652026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10497157529138641600celadon.ai82026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7961085009656920800circlecoin.ai42026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5820102001571671200city-deal.ai562026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 13789294256553334600claimshero.ai732026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 104966636901077000cleanlakes.ai852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16057244428748808200clipped.ai412026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4586704981495006000cn.ai302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10734721455404820800communis.ai42026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7525297700192847800computers.ai392026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 302526090888577600coretechx.ai882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15350542704418591800counterintuitive.ai592026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 615925490405063000critdream.ai152026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12162689017575076800dano.ai842026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10470638089344213200dasher.ai662026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11203146822354492400datareality.ai622026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16969550539548863000devoteam.ai152026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:937 6772241591002930200digitalmedia.ai512026-01-06 03:09:552026-04-13 09:10:169372026-04-13 09:10:16laksa000
SPAM:0 17155359333985852400distro.ai622026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17201826006523552600doqfy.ai632026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7903351438421572200drivecore.ai612026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5292495381306044400ductlesshvac.ai222026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 8228060052594394800eduprompt.ai742026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4038680204547955200eizie.ai762026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 10219011610810115200elapse.ai762026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9565668684276124600elizafoundation.ai232026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16841580336023964600ello.ai232026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3324414712609219200enprose.ai962026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16369158873814916400eon.ai822026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 17783419701302410200evers.ai512026-02-10 04:07:202026-03-31 17:25:0410002026-03-31 17:25:04laksa000
SPAM:0 14880639617209404400fdc.ai222026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17029576775020977400feature.ai872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:800 4232254899762319400finadvice.ai972026-02-10 04:07:202026-03-31 17:25:048002026-03-31 17:25:04laksa000
SPAM:0 8553541449706201800fluidflow.ai92026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8324590692574489800flux3d.ai492026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:769 8435669362558784200freedetector.ai212026-03-18 05:55:242026-03-18 05:55:247692026-03-18 05:55:24laksa000
SPAM:0 3419052279211209200fsystems.ai462026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1400482850199474800galleru.ai742026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 14655430921083847600gatana.ai382026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10296836467935438400getmsg.ai922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6123094115647751400glared.ai572026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 6115537360224548200grapesstudio.ai412026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:666 16020535290866654000growmyrx.ai702026-01-06 03:09:552026-04-13 09:10:166662026-04-13 09:10:16laksa000
SPAM:0 16766436588720448200growthforge.ai412026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 2264411623749844400haise.ai222026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))