dlink-forum.it
robots.txt

Robots Exclusion Standard data for dlink-forum.it

Resource Scan

Scan Details

Site Domain dlink-forum.it
Base Domain dlink-forum.it
Scan Status Ok
Last Scan5/27/2025, 2:29:50 PM
Next Scan 6/3/2025, 2:29:50 PM

Last Scan

Scanned5/27/2025, 2:29:50 PM
URL https://dlink-forum.it/robots.txt
Redirect https://www.dlink-forum.it/robots.txt
Redirect Domain www.dlink-forum.it
Redirect Base dlink-forum.it
Domain IPs 89.46.110.68
Redirect IPs 89.46.110.68
Response IP 89.46.110.68
Found Yes
Hash 15e12d7455fef58d2dd18e25ae640db4b0052e5fa2e3f86e59b3c1de924e8411
SimHash 2356d5f2de80

Groups

sogou web spider

Rule Path
Disallow /

dotbot
mj12bot
petalbot
ahrefsbot
semrushbot
aspiegelbot
semrush
mauibot
baiduspider

Rule Path
Disallow /

adsbot-google
adsbot-google-mobile
mediapartners-google

Rule Path
Allow /

*

Rule Path
Disallow /*action
Disallow /*PHPSESSID
Disallow /*%3B
Disallow /cron.php*
Allow /$
Allow /*board%3D*.0$
Allow /*topic%3D*.0$
Allow /*.xml
Allow /*.css$
Allow /*.js$
Allow /*.png$
Allow /*.jpg$
Allow /*.gif$

Other Records

Field Value
sitemap https://www.dlink-forum.it/sitemap.xml