urdupod101.com
robots.txt
Robots Exclusion Standard data for urdupod101.com
Resource Scan
Scan Details
| Site Domain | urdupod101.com |
| Base Domain | urdupod101.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T12:57:40+00:00 |
| Next Scan | 2024-10-05T12:57:40+00:00 |
Last Scan
| Scanned | 2024-09-21T12:57:40+00:00 |
| URL | https://urdupod101.com/robots.txt |
| Redirect | https://www.urdupod101.com:443/robots.txt |
| Redirect Domain | www.urdupod101.com |
| Redirect Base | urdupod101.com |
| Domain IPs | 108.157.254.113, 108.157.254.124, 108.157.254.53, 108.157.254.98 |
| Redirect IPs | 108.157.254.113, 108.157.254.124, 108.157.254.53, 108.157.254.98 |
| Response IP | 108.157.254.53 |
| Found | Yes |
| Hash | 7e76d197ce336ca8140b1cdecd1053c1d91ab38b5131dfc47ecea60b5a94270b |
| SimHash | ff17dcd0cbd2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cart/ |
| Disallow | /member/ |
| Disallow | /basic_feed/ |
| Disallow | /premium_feed/ |
| Disallow | /event_tracking.php |
| Disallow | */feed$ |
| Disallow | */feed/$ |
| Disallow | /feed.xml |
| Disallow | /feed/xml |
| Disallow | /?p= |
| Disallow | /calendar |
| Disallow | /search |
| Disallow | /tag |
| Disallow | /forum/search.php |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/style.php |
| Disallow | /forum/profile.php |
| Disallow | /forum/posting.php |
| Disallow | /blog/?s=* |