db-z.com
robots.txt

Robots Exclusion Standard data for db-z.com

Resource Scan

Scan Details

Site Domain db-z.com
Base Domain db-z.com
Scan Status Ok
Last Scan2024-09-22T14:37:29+00:00
Next Scan 2024-09-29T14:37:29+00:00

Last Scan

Scanned2024-09-22T14:37:29+00:00
URL https://db-z.com/robots.txt
Domain IPs 51.83.79.145
Response IP 51.83.79.145
Found Yes
Hash 69be332b8d6a04610bf53e7eb1220fd7971bde9041bc2e93156098c6ab45effe
SimHash cf0fc801d8a9

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /tag/*
Disallow /amp/tag/*
Disallow *cron.php*
Disallow */amp/*
Disallow /forum/*action
Disallow /forum/*PHPSESSID
Disallow /forum/*
Allow /forum/$
Allow /forum/*board*.html$
Allow /forum/*topic*.html$
Allow /forum/*.xml
Disallow /?s=*
Disallow /search/*

gptbot
nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.db-z.com/sitemap_index.xml

Comments

  • Test pour éviter le spam des résultats de recherche