ngdgame.com
robots.txt
Robots Exclusion Standard data for ngdgame.com
Resource Scan
Scan Details
Site Domain | ngdgame.com |
Base Domain | ngdgame.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-04T00:55:43+00:00 |
Next Scan | 2024-10-03T00:55:43+00:00 |
Last Successful Scan
Scanned | 2024-06-06T00:40:07+00:00 |
URL | https://ngdgame.com/robots.txt |
Domain IPs | 158.101.86.247 |
Response IP | 158.101.86.247 |
Found | Yes |
Hash | 521194f501d6244dd28c3263600425c0ba4345d6782ac1547beb59150ce84756 |
SimHash | 6b2c1e44c1b8 |
Groups
*
Rule | Path |
---|---|
Disallow | /upload |
Disallow | /theme |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://ngdgame.com/sitemap.xml |