rpg-directory.com
robots.txt
Robots Exclusion Standard data for rpg-directory.com
Resource Scan
Scan Details
Site Domain | rpg-directory.com |
Base Domain | rpg-directory.com |
Scan Status | Ok |
Last Scan | 2024-10-07T14:05:06+00:00 |
Next Scan | 2024-10-14T14:05:06+00:00 |
Last Scan
Scanned | 2024-10-07T14:05:06+00:00 |
URL | https://rpg-directory.com/robots.txt |
Domain IPs | 104.161.46.138 |
Response IP | 104.161.46.138 |
Found | Yes |
Hash | 18ae08e97e916a2b19af8565478f90d43872ef16bb03764046d24832b8e34e05 |
SimHash | ca16551bcd80 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php?act=calendar* |
Disallow | /index.php?act=daffiliates* |
Disallow | /index.php?act=Post* |
Disallow | /index.php?act=Forward* |
Disallow | /index.php?act=Track* |
Disallow | /index.php?act=Msg* |
Disallow | /index.php?act=Search* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Comments