forum.fedoraonline.it
robots.txt

Robots Exclusion Standard data for forum.fedoraonline.it

Resource Scan

Scan Details

Site Domain forum.fedoraonline.it
Base Domain fedoraonline.it
Scan Status Ok
Last Scan2025-08-12T00:06:29+00:00
Next Scan 2025-09-11T00:06:29+00:00

Last Scan

Scanned2025-08-12T00:06:29+00:00
URL https://forum.fedoraonline.it/robots.txt
Domain IPs 104.21.37.150, 172.67.209.186, 2606:4700:3030::6815:2596, 2606:4700:3037::ac43:d1ba
Response IP 104.21.37.150
Found Yes
Hash 80d648deb57d9b48b12e54595a8d7c57065316497e8c724fc6c3d323a6849809
SimHash 2a9cddc5e260

Groups

*

Rule Path
Disallow /auth/
Disallow /assets/browser-update*.js
Disallow /users/
Disallow /u/
Disallow /my/
Disallow /badges/
Disallow /search
Disallow /search/
Disallow /tags
Disallow /tags/
Disallow /email/
Disallow /session
Disallow /session/
Disallow /admin
Disallow /admin/
Disallow /user-api-key
Disallow /user-api-key/
Disallow /*?api_key*
Disallow /*?*api_key*
Disallow /groups
Disallow /groups/
Disallow /t/*/*.rss
Disallow /tags/*.rss
Disallow /c/*.rss

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seo spider

Rule Path
Disallow /

bingbot

Rule Path
Disallow /auth/
Disallow /assets/browser-update*.js
Disallow /users/
Disallow /u/
Disallow /my/
Disallow /badges/
Disallow /search
Disallow /search/
Disallow /tags
Disallow /tags/
Disallow /email/
Disallow /session
Disallow /session/
Disallow /admin
Disallow /admin/
Disallow /user-api-key
Disallow /user-api-key/
Disallow /*?api_key*
Disallow /*?*api_key*
Disallow /groups
Disallow /groups/
Disallow /t/*/*.rss
Disallow /tags/*.rss
Disallow /c/*.rss

Other Records

Field Value
crawl-delay 60

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file