🤖 Robots Target Settings — Block & Manage

Source: laksa000-laksa199.robots.target_settings_local (200 shards)

Block URL from Index

Blocking example.com blocks ALL pages under it. Blocking example.com/page blocks only that prefix.

Search Existing Records

URL search queries one shard (fast). Comment search queries all 200 shards (slower, for auditing batches).

Browse by Shard

▶
Shard:
  Records in this shard: 113,968
Showing: Page 7 from laksa000
Statussrc_root_hash↕URL↕int_partition_id↕Created↕Updated↕Comment↕crawler_dont_crawl↕crawler_crawl_delay_override↕fh_dont_index↕se_spam_state↕se_is_spam↕se_is_not_spam↕ml_spam_score↕ml_updated_at↕Host↕Delete
SPAM:0 13564002845341568800avantgard.al442026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 16137497205496972200casanova.al612026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 1248729514778917400centenni.al872026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 9016024100728418200edukimi.al912026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 17295784614780870000gazetatema.al502026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3544442456787156400incubator.al822026-01-13 07:00:512026-02-17 04:58:2902026-02-17 04:58:29laksa000
SPAM:0 14682302879252874400peripher.al722026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:940 9177835691870915600planover.al782026-03-24 07:10:182026-04-13 09:10:169402026-04-13 09:10:16laksa000
SPAM:1000 5434885549223533800qv.al692026-01-06 03:09:552026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 1066408444197721600sense.al82026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:846 7400621134535252200sourcecode.al612026-01-06 03:09:552026-04-13 09:10:168462026-04-13 09:10:16laksa000
SPAM:0 15498953803470629000techoice.al452026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:947 3842354162927549400xaricdetehsil.al472026-01-06 03:09:552026-04-13 09:10:169472026-04-13 09:10:16laksa000
SPAM:900 6597678581996280600abeilles.alsace32026-01-06 03:09:552026-04-13 09:10:169002026-04-13 09:10:16laksa000
SPAM:0 3258180043444259800art.alsace992026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 131038629755624356003q.am782026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:900 14704662187075402000agimpex.am102026-01-13 07:00:512026-03-18 05:55:249002026-03-18 05:55:24laksa000
SPAM:0 13777769323641637000alexandra-spa.am852026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:894 10202233620601341800arabkiruccf.am92026-02-03 06:27:312026-04-13 09:10:168942026-04-13 09:10:16laksa000
SPAM:0 11732670036830701200armateni.am62026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 7945073025291704400armcom.am222026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8207089521579329400atmc.am472026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 11294827164057454400aurorahotel.am722026-04-13 09:10:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 6589267070455291000brightindustry.am552026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:705 9948298960194734800cdd.am742026-03-24 07:10:182026-03-24 07:10:187052026-03-24 07:10:18laksa000
SPAM:0 12218070328265197600default.am882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4640270334399118600eins.am932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14203847157082978600expertmedical.am932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10526510639484102400hashvapah.am122026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11936203315917432600hoh.am632026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 4399292738911573400ihouse.am672026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 2269196484566289600kwant.am482026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 5497826751220362400lratvutyun.am122026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 14066328678162813600minimarket.am682026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 12417833309447760800mitani.am42026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 10552516455433550000mozg.am502026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 899775188975223000ncat.am152026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 6361847666697876600nm.am832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3083223683496943600numberone.am182026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10471291175815918400quipu.am922026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 8540488553638360000replik.am02026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16748919289845855400sisianmuseum.am772026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:700 5785331896725938800slidecomp.am942026-01-13 07:00:512026-04-13 09:10:167002026-04-13 09:10:16laksa000
SPAM:0 2731672231935197600startupfund.am882026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 11543427305359062800tourdeluxe.am142026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:956 11943511789364058600virtualreceptionist.am932026-03-18 05:55:242026-04-13 09:10:169562026-04-13 09:10:16laksa000
SPAM:0 17433287128892740800dinnertrain.amsterdam42026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:909 5782661491029876000nationalportraitgallery.amsterdam802026-03-31 17:25:042026-04-13 09:10:169092026-04-13 09:10:16laksa000
SPAM:0 6153798807158515800pianostemmer.amsterdam792026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 12248934406578115000rd.amsterdam752026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:960 16262436675008382200swell.amsterdam112026-01-06 03:09:552026-04-13 09:10:169602026-04-13 09:10:16laksa000
SPAM:0 17180925077401027800way.amsterdam392026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 2171515265129195000dgmc.co.ao752026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 3522807867943170800frial.co.ao542026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15967328097813701400nivel-one.ao72026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 38700183635168092000207.app462026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 108132015223634856000day.app282026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 34809885330159766000xpo.app832026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 441427418463908600010000.app302026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1444863254334762080011papuwa4d.app42026-02-03 06:27:312026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 2810847214569822002200.app112026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 381953238677506520022fun.app262026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 39106991881860416002828a.app82026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 165512080277624528003059966.app642026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 4837320635945104000336htbet.app202026-03-31 17:25:042026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 120348785332062364003377057.app822026-03-31 17:25:042026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 2111794190315400000337711.app02026-03-31 17:25:042026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 88996615425580572003377779.app862026-03-18 05:55:242026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:1000 138359768386860374003377804e.app872026-01-13 07:00:512026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 1748947265592276860036mh.app432026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 15370684101993348004449.app742026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 57659489543453824004stages.app122026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:980 16034998072794439000711876.app952026-01-13 07:00:512026-04-13 09:10:169802026-04-13 09:10:16laksa000
SPAM:0 11113329228470804400777slot-br.app222026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 1755521547876365380079king78.app692026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:1000 99133443371102908007v899.app542026-02-03 06:27:312026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:1000 158892668829854202008868k2.app12026-03-24 07:10:182026-03-24 07:10:1810002026-03-24 07:10:18laksa000
SPAM:1000 87637730197694354008971118.app772026-02-17 04:56:342026-03-18 05:55:2410002026-03-18 05:55:24laksa000
SPAM:0 2652910286141369400919.app472026-01-06 03:09:552026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:1000 10018633273891080200967vip.app12026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 345440414127216720097738.app362026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 6115578100816229600accert.app482026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 11165378687913255600accesnovum.app782026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3088407584483174800agendfy.app742026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16062462875314861400akios.app72026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 17274184595345537000alchemyst.app852026-01-13 07:00:512026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:0 14829901869273603800alexander-casino.app192026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 10177672303825381000alternatif.app52026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000
SPAM:0 16500957421463901400animix.app72026-01-06 03:09:552026-03-24 07:17:2502026-03-24 07:17:25laksa000
SPAM:0 16531562960465309400anysave.app472026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:800 18385962118345895000appmaker.app752026-01-06 03:09:552026-03-24 07:10:188002026-03-24 07:10:18laksa000
SPAM:0 8524181531766026600archero2.app332026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:0 3457959372164834400artway.app722026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 16558312889833461800asiabetking.app92026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:800 3009949669819813400asialuxe.app672026-01-22 02:10:162026-04-13 09:10:168002026-04-13 09:10:16laksa000
SPAM:0 4643085193945225600automath.app282026-01-06 03:09:552026-01-20 03:10:1702026-01-20 03:10:17laksa000
SPAM:1000 14303168920219263800az888.app192026-01-06 03:09:552026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 8426987985226172200b2box.app612026-01-06 03:09:552026-03-18 05:56:3402026-03-18 05:56:34laksa000
SPAM:1000 12686598618921438400bancanohu.app922026-01-14 03:13:162026-04-13 09:10:1610002026-04-13 09:10:16laksa000
SPAM:0 719446386700658600baohiem.app932026-01-13 07:00:512026-01-20 05:08:2402026-01-20 05:08:24laksa000

Advanced: Add Record

▶

Full form with all columns. For simple blocking, use the "Block URL" section above.

Enter a URL or domain name (e.g., example.com)
Prevent crawlers from accessing this URL
Prevent indexing of this URL content
Spam flag (integer, optional)
ML spam score (integer, optional)
Optional comment about this record

Table Schema

▶
ColumnType
src_root_hashUInt64
src_unparsed_prefixString
int_partition_idUInt8
int_created_atSimpleAggregateFunction(min, Nullable(DateTime))
int_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))
int_commentSimpleAggregateFunction(anyLast, Nullable(String))
crawler_dont_crawlSimpleAggregateFunction(anyLast, Nullable(UInt8))
crawler_crawl_delay_overrideSimpleAggregateFunction(anyLast, Nullable(Float32))
fh_dont_indexSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_spam_stateSimpleAggregateFunction(anyLast, Nullable(Enum8('unknown' = 0, 'spam' = 1, 'not_spam' = 2)))
se_is_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
se_is_not_spamSimpleAggregateFunction(anyLast, Nullable(UInt8))
ml_spam_scoreSimpleAggregateFunction(anyLast, Nullable(UInt32))
ml_updated_atSimpleAggregateFunction(anyLast, Nullable(DateTime))