perlego.com
robots.txt
Robots Exclusion Standard data for perlego.com
Resource Scan
Scan Details
Site Domain | perlego.com |
Base Domain | perlego.com |
Scan Status | Ok |
Last Scan | 2024-06-21T22:48:14+00:00 |
Next Scan | 2024-07-21T22:48:14+00:00 |
Last Scan
Scanned | 2024-06-21T22:48:14+00:00 |
URL | https://perlego.com/robots.txt |
Redirect | https://www.perlego.com/robots.txt |
Redirect Domain | www.perlego.com |
Redirect Base | perlego.com |
Domain IPs | 172.66.40.176, 172.66.43.80, 2606:4700:3108::ac42:28b0, 2606:4700:3108::ac42:2b50 |
Redirect IPs | 172.66.40.176, 172.66.43.80, 2606:4700:3108::ac42:28b0, 2606:4700:3108::ac42:2b50 |
Response IP | 172.66.40.176 |
Found | Yes |
Hash | df2fcb08a020bb4093d0d153c6fb6f0cfcb02d574ed2180d38fcb53c3ecafe83 |
SimHash | 6232ec466ada |
Groups
*
Rule | Path |
---|---|
Disallow | /*?queryID=* |
Disallow | /book/*?tab=book |
Disallow | /browse/*?page=*&page=* |
Disallow | /browse/*?tab=book |
Disallow | /cancellation |
Disallow | /confirmation |
Disallow | /*help%40perlego.com |
Disallow | /payment-details |
Disallow | /*press%40perlego.com |
Disallow | /profile |
Disallow | /publisher/*?page=*&page=* |
Disallow | /reactivation |
Disallow | /search* |
Disallow | /settings |
Disallow | /want-to-read |
Disallow | /welcome |
Disallow | /es/*?queryID=* |
Disallow | /es/book/*?tab=book |
Disallow | /es/browse/*?page=*&page=* |
Disallow | /es/browse/*?tab=book |
Disallow | /es/cancellation |
Disallow | /es/confirmation |
Disallow | /es/*help%40perlego.com |
Disallow | /es/payment-details |
Disallow | /es/*press%40perlego.com |
Disallow | /es/profile |
Disallow | /es/publisher/*?page=*&page=* |
Disallow | /es/reactivation |
Disallow | /es/search* |
Disallow | /es/settings |
Disallow | /es/want-to-read |
Disallow | /es/welcome |
Disallow | /fr/*?queryID=* |
Disallow | /fr/book/*?tab=book |
Disallow | /fr/browse/*?page=*&page=* |
Disallow | /fr/browse/*?tab=book |
Disallow | /fr/cancellation |
Disallow | /fr/confirmation |
Disallow | /fr/*help%40perlego.com |
Disallow | /fr/payment-details |
Disallow | /fr/*press%40perlego.com |
Disallow | /fr/profile |
Disallow | /fr/publisher/*?page=*&page=* |
Disallow | /fr/reactivation |
Disallow | /fr/search* |
Disallow | /fr/settings |
Disallow | /fr/want-to-read |
Disallow | /fr/welcome |
Disallow | /it/*?queryID=* |
Disallow | /it/book/*?tab=book |
Disallow | /it/browse/*?page=*&page=* |
Disallow | /it/browse/*?tab=book |
Disallow | /it/cancellation |
Disallow | /it/confirmation |
Disallow | /it/*help%40perlego.com |
Disallow | /it/payment-details |
Disallow | /it/*press%40perlego.com |
Disallow | /it/profile |
Disallow | /it/publisher/*?page=*&page=* |
Disallow | /it/reactivation |
Disallow | /it/search* |
Disallow | /it/settings |
Disallow | /it/want-to-read |
Disallow | /it/welcome |
Disallow | /de/*?queryID=* |
Disallow | /de/book/*?tab=book |
Disallow | /de/browse/*?page=*&page=* |
Disallow | /de/browse/*?tab=book |
Disallow | /de/cancellation |
Disallow | /de/confirmation |
Disallow | /de/*help%40perlego.com |
Disallow | /de/payment-details |
Disallow | /de/*press%40perlego.com |
Disallow | /de/profile |
Disallow | /de/publisher/*?page=*&page=* |
Disallow | /de/reactivation |
Disallow | /de/search* |
Disallow | /de/settings |
Disallow | /de/want-to-read |
Disallow | /de/welcome |
Other Records
Field | Value |
---|---|
sitemap | https://sitemap.perlego.com/sitemap_index.xml |