agecalculator.org
robots.txt
Robots Exclusion Standard data for agecalculator.org
Resource Scan
Scan Details
Site Domain | agecalculator.org |
Base Domain | agecalculator.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-10T15:13:44+00:00 |
Next Scan | 2024-06-17T15:13:44+00:00 |
Last Successful Scan
Scanned | 2024-06-02T15:12:36+00:00 |
URL | https://agecalculator.org/robots.txt |
Redirect | https://www.agecalculator.org/robots.txt |
Redirect Domain | www.agecalculator.org |
Redirect Base | agecalculator.org |
Domain IPs | 104.21.28.74, 172.67.144.186, 2606:4700:3031::ac43:90ba, 2606:4700:3036::6815:1c4a |
Redirect IPs | 138.199.46.68, 2400:52e0:1500::868:1 |
Response IP | 138.199.46.68 |
Found | Yes |
Hash | 80ed32501abb853ba0a4d415646d117c16852b4559e347376a4abb01aca63bab |
SimHash | 19607526e491 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /_ignition/ |
Disallow | /_profiler/ |
Disallow | /.env |
Disallow | /wiki/ |
Disallow | /*wp-includes/ |
Disallow | /*site/ |
Disallow | /*sito/ |
Disallow | /0000* |
Disallow | /0byte |
Disallow | /*.php |
Disallow | /*.aspx |
Disallow | /*.css |
Disallow | /*.js |
Disallow | /123 |
Disallow | /404_icon.png |
Disallow | /*net-worth* |
Disallow | /admin/ |
Disallow | /assets/ |
Disallow | /.well-known/ |
Disallow | /backup |
Disallow | /bk |
Disallow | /celebrity* |
Disallow | /club/ |
Disallow | /cms/ |
Disallow | /core/ |
Disallow | /css/ |
Disallow | /data/ |
Disallow | /tags/ |
Disallow | /dev |
Disallow | /e/ |
Disallow | /emma* |
Disallow | /en/ |
Disallow | /everything-you-need* |
Disallow | /fileupload/ |
Disallow | /fonts/ |
Disallow | /go/ |
Disallow | /health/ |
Disallow | /history/ |
Disallow | /home |
Disallow | /index |
Disallow | /js/calendar/ |
Disallow | /js/slick/ |
Disallow | /label/ |
Disallow | /michael* |
Disallow | /news/ |
Disallow | /newsite |
Disallow | /page/ |
Disallow | /pagenotfound.html |
Disallow | /person/ |
Disallow | /poets/ |
Disallow | /public/ |
Disallow | /ro-khanna-height/ |
Disallow | /robert-duvall-net-worth/ |
Disallow | /sections/ |
Disallow | /server/ |
Disallow | /sitemap |
Disallow | /sites/ |
Disallow | /static/ |
Disallow | /test |
Disallow | /testing |
Disallow | /topics/ |
Disallow | /travelling-to* |
Disallow | /upload/ |
Disallow | /view-source* |
Disallow | /who-is-shoe* |
Disallow | /works/ |
Disallow | /.git/ |
Disallow | /go/ |
Disallow | /*.gif$ |
Disallow | /how-old-am-i-today/1953 |
Other Records
Field | Value |
---|---|
sitemap | https://www.agecalculator.org/sitemap.xml |