betexplorer.com
robots.txt
Robots Exclusion Standard data for betexplorer.com
Resource Scan
Scan Details
Site Domain | betexplorer.com |
Base Domain | betexplorer.com |
Scan Status | Ok |
Last Scan | 2024-06-27T06:07:50+00:00 |
Next Scan | 2024-07-04T06:07:50+00:00 |
Last Scan
Scanned | 2024-06-27T06:07:50+00:00 |
URL | https://betexplorer.com/robots.txt |
Redirect | https://www.betexplorer.com/robots.txt |
Redirect Domain | www.betexplorer.com |
Redirect Base | betexplorer.com |
Domain IPs | 188.92.41.190 |
Redirect IPs | 188.92.41.190 |
Response IP | 188.92.41.190 |
Found | Yes |
Hash | 412b9a0f3c2a9e6ee8ac679dc64f379e6ba73050cc685850893b6dac44c6367b |
SimHash | 480ca252c617 |
Groups
*
Rule | Path |
---|---|
Disallow | /ad/ |
Disallow | /redirect/ |
Disallow | /bookmaker/ |
Disallow | /*?stage= |
Disallow | /*?year= |
Disallow | /*?activecountry= |
Disallow | /*?set_ticket= |
Disallow | /*?match= |
Disallow | /reviews/go/* |
Disallow | /reviews/*?*s=* |
Disallow | /reviews/goto/* |
Disallow | /reviews/wp-admin/* |
Allow | /reviews/wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.betexplorer.com/sitemap_index.xml |
sitemap | https://www.betexplorer.com/reviews/sitemap_index.xml |