ziffdavis.com
robots.txt
Robots Exclusion Standard data for ziffdavis.com
Resource Scan
Scan Details
Site Domain | ziffdavis.com |
Base Domain | ziffdavis.com |
Scan Status | Ok |
Last Scan | 2024-04-11T05:28:29+00:00 |
Next Scan | 2024-05-11T05:28:29+00:00 |
Last Scan
Scanned | 2024-04-11T05:28:29+00:00 |
URL | https://ziffdavis.com/robots.txt |
Redirect | https://www.ziffdavis.com/robots.txt |
Redirect Domain | www.ziffdavis.com |
Redirect Base | ziffdavis.com |
Domain IPs | 3.216.153.158, 52.201.56.224 |
Redirect IPs | 23.215.7.68, 23.215.7.71 |
Response IP | 23.52.40.177 |
Found | Yes |
Hash | 61d0911968cbf7222747e17010deb4dedf1b8be44cddbabd36e7bab62f11d74f |
SimHash | 4b20ccc0a0b3 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-login.php |
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /?s= |
Disallow | /search/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.j2global.com/sitemap_index.xml |