fiatforum.com
robots.txt
Robots Exclusion Standard data for fiatforum.com
Resource Scan
Scan Details
Site Domain | fiatforum.com |
Base Domain | fiatforum.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-17T17:10:06+00:00 |
Next Scan | 2024-10-17T17:10:06+00:00 |
Last Successful Scan
Scanned | 2024-08-19T17:03:24+00:00 |
URL | https://fiatforum.com/robots.txt |
Domain IPs | 104.21.58.204, 172.67.164.166, 2606:4700:3030::6815:3acc, 2606:4700:3034::ac43:a4a6 |
Response IP | 172.67.164.166 |
Found | Yes |
Hash | 5f91716eb141875769a9e9e8f394394481ef6dbe0b4a6de9bef2e78f4652027d |
SimHash | 463e50e1ee91 |
Groups
ahrefsbot
dotbot
mj12bot
blexbot
domainstatsbot
zoomspider
mauibot
megaindex.ru
megaindex.com
ltx71 - (http://ltx71.com/)
petalbot
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /account/ |
Disallow | /classifieds/authors/ |
Disallow | /donate/ |
Disallow | /goto/ |
Disallow | /login/ |
Disallow | /logout/ |
Disallow | /lost-password/ |
Disallow | /media/comments/ |
Disallow | /members/ |
Disallow | /online/ |
Disallow | /posts/ |
Disallow | /register/ |
Disallow | /search/ |
Disallow | /tags/ |
Disallow | /whats-new/ |
Disallow | /admin.php |
Disallow | /index.php?sam-item%2F |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.fiatforum.com/sitemap.xml |
Comments