gotporn.com
robots.txt
Robots Exclusion Standard data for gotporn.com
Resource Scan
Scan Details
| Site Domain | gotporn.com |
| Base Domain | gotporn.com |
| Scan Status | Ok |
| Last Scan | 2024-08-30T01:29:28+00:00 |
| Next Scan | 2024-09-29T01:29:28+00:00 |
Last Scan
| Scanned | 2024-08-30T01:29:28+00:00 |
| URL | https://gotporn.com/robots.txt |
| Redirect | https://www.gotporn.com/robots.txt |
| Redirect Domain | www.gotporn.com |
| Redirect Base | gotporn.com |
| Domain IPs | 159.223.211.188, 178.62.209.162, 2a03:b0c0:2:d0::1098:4001, 2a03:b0c0:2:d0::150b:f001 |
| Redirect IPs | 159.223.211.188, 178.62.209.162, 2a03:b0c0:2:d0::1098:4001, 2a03:b0c0:2:d0::150b:f001 |
| Response IP | 178.62.209.162 |
| Found | Yes |
| Hash | 6e5898c3b17d36127f90a2fd05b8cb204583c46bf009d1df0f9b2b4f653201bb |
| SimHash | 13144022c631 |
Groups
*
| Rule | Path |
|---|---|
| Allow | *arch/a/* |
| Disallow | /out/ |
| Disallow | /*?page=** |
| Disallow | */search* |
| Disallow | /*queryString%3D* |
| Disallow | /*orientation%3D* |
| Disallow | /*all%3D* |
| Disallow | */set-locale* |
| Disallow | /*?filter* |
| Disallow | /*?pricing=* |
| Disallow | /thumb/ |
| Disallow | /3thumbs/ |
| Disallow | *US_CENSUS_NAME* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.gotporn.com/sitemap.xml |
Comments