rubicon.com
robots.txt

Robots Exclusion Standard data for rubicon.com

Resource Scan

Scan Details

Site Domain rubicon.com
Base Domain rubicon.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-05-01T01:38:31+00:00
Next Scan 2024-06-30T01:38:31+00:00

Last Successful Scan

Scanned2023-04-15T01:20:11+00:00
URL https://rubicon.com/robots.txt
Redirect https://www.rubicon.com/robots.txt
Redirect Domain www.rubicon.com
Redirect Base rubicon.com
Domain IPs 23.185.0.4, 2620:12a:8000::4, 2620:12a:8001::4
Redirect IPs 23.185.0.4, 2620:12a:8000::4, 2620:12a:8001::4
Response IP 23.185.0.4
Found Yes
Hash 018a3ae7521deea8f9e108b06127eae865fa8b9be6c2a692a2a306282f51a7e0
SimHash 6900dc404992

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.rubicon.com/sitemap_index.xml