persistent.com
robots.txt
Robots Exclusion Standard data for persistent.com
Resource Scan
Scan Details
Site Domain | persistent.com |
Base Domain | persistent.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-24T01:02:24+00:00 |
Next Scan | 2024-08-22T01:02:24+00:00 |
Last Successful Scan
Scanned | 2024-01-02T23:32:01+00:00 |
URL | https://persistent.com/robots.txt |
Redirect | https://www.persistent.com/robots.txt |
Redirect Domain | www.persistent.com |
Redirect Base | persistent.com |
Domain IPs | 54.156.8.155 |
Redirect IPs | 18.155.68.110, 18.155.68.37, 18.155.68.40, 18.155.68.72, 2600:9000:23d2:3400:16:73ac:d140:93a1, 2600:9000:23d2:3800:16:73ac:d140:93a1, 2600:9000:23d2:3e00:16:73ac:d140:93a1, 2600:9000:23d2:9000:16:73ac:d140:93a1, 2600:9000:23d2:a00:16:73ac:d140:93a1, 2600:9000:23d2:a600:16:73ac:d140:93a1, 2600:9000:23d2:e800:16:73ac:d140:93a1, 2600:9000:23d2:fc00:16:73ac:d140:93a1 |
Response IP | 13.249.9.49 |
Found | Yes |
Hash | 6c1a566b2553dd50e486aebef2e539df0cf7630662775e1b8fa73b124251ca4a |
SimHash | 02a1c860a432 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Allow | /wp-content/uploads/ |
Disallow | /wp-admin/ |
Disallow | /blogs/tag/ |
Disallow | /wp-content/plugins/ |
Disallow | /*feed/$ |
Disallow | /*feed/rss2/$ |
Disallow | /wp-content/uploads/2023/02/Persistent-Cloud-Case-Studies-Lookbook.pdf |
Disallow | /wp-content/uploads/2023/10/Demo-1-Engineering-Excellence-using-ExtenSure-and-GenAI.pdf |
Disallow | /wp-content/uploads/2023/10/Demo-2-Financial-Data-Analysis-using-GenAI.pdf |
Disallow | /wp-content/uploads/2023/10/Demo-3-Empowering-Biometric-Security-via-Advanced-AI.pdf |
Disallow | /wp-content/uploads/2023/10/Demo-4-Automation-of-Enterprise-Cloud-Infrastructure-Design.pdf |
Disallow | /wp-content/uploads/2023/10/Demo-5-GenAI-powered-Interview-Evaluation.pdf |
Disallow | /wp-content/uploads/2023/10/Anand-Deshpande-Journey-of-Persistent-Systems.pdf |
Disallow | /wp-content/uploads/2023/10/Sandeep-Kalra-Growing-together-with-Persistent-Systems.pdf |
Disallow | /wp-content/uploads/2023/10/Jaideep-Dhok-Innovating-today-Transforming-tomorrow.pdf |
Allow | /wp-content/uploads/*yoast |
Allow | /wp-content/uploads/*twitter |
Allow | /wp-content/uploads/*tw |
Allow | /wp-admin/admin-ajax.php |
Allow | /wp-content/uploads/2020/09/twitter-yoast-homepage-see-beyond-rise-above.jpg |
Allow | /wp-content/uploads/2020/09/tw-yoast-image-midnight-bue-horizontal.jpg |
Allow | /wp-content/uploads/2020/09/tw-yoast-images-midnight-blue-vertical.jpg |
Other Records
Field | Value |
---|---|
sitemap | https://www.persistent.com/sitemap_index.xml |
sitemap | https://careers.persistent.com/sitemap.xml |