agecalculator.org
robots.txt
Robots Exclusion Standard data for agecalculator.org
Resource Scan
Scan Details
| Site Domain | agecalculator.org |
| Base Domain | agecalculator.org |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-17T15:14:20+00:00 |
| Next Scan | 2024-07-01T15:14:20+00:00 |
Last Successful Scan
| Scanned | 2024-06-02T15:12:36+00:00 |
| URL | https://agecalculator.org/robots.txt |
| Redirect | https://www.agecalculator.org/robots.txt |
| Redirect Domain | www.agecalculator.org |
| Redirect Base | agecalculator.org |
| Domain IPs | 104.21.28.74, 172.67.144.186, 2606:4700:3031::ac43:90ba, 2606:4700:3036::6815:1c4a |
| Redirect IPs | 138.199.46.68, 2400:52e0:1500::868:1 |
| Response IP | 138.199.46.68 |
| Found | Yes |
| Hash | 80ed32501abb853ba0a4d415646d117c16852b4559e347376a4abb01aca63bab |
| SimHash | 19607526e491 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /_ignition/ |
| Disallow | /_profiler/ |
| Disallow | /.env |
| Disallow | /wiki/ |
| Disallow | /*wp-includes/ |
| Disallow | /*site/ |
| Disallow | /*sito/ |
| Disallow | /0000* |
| Disallow | /0byte |
| Disallow | /*.php |
| Disallow | /*.aspx |
| Disallow | /*.css |
| Disallow | /*.js |
| Disallow | /123 |
| Disallow | /404_icon.png |
| Disallow | /*net-worth* |
| Disallow | /admin/ |
| Disallow | /assets/ |
| Disallow | /.well-known/ |
| Disallow | /backup |
| Disallow | /bk |
| Disallow | /celebrity* |
| Disallow | /club/ |
| Disallow | /cms/ |
| Disallow | /core/ |
| Disallow | /css/ |
| Disallow | /data/ |
| Disallow | /tags/ |
| Disallow | /dev |
| Disallow | /e/ |
| Disallow | /emma* |
| Disallow | /en/ |
| Disallow | /everything-you-need* |
| Disallow | /fileupload/ |
| Disallow | /fonts/ |
| Disallow | /go/ |
| Disallow | /health/ |
| Disallow | /history/ |
| Disallow | /home |
| Disallow | /index |
| Disallow | /js/calendar/ |
| Disallow | /js/slick/ |
| Disallow | /label/ |
| Disallow | /michael* |
| Disallow | /news/ |
| Disallow | /newsite |
| Disallow | /page/ |
| Disallow | /pagenotfound.html |
| Disallow | /person/ |
| Disallow | /poets/ |
| Disallow | /public/ |
| Disallow | /ro-khanna-height/ |
| Disallow | /robert-duvall-net-worth/ |
| Disallow | /sections/ |
| Disallow | /server/ |
| Disallow | /sitemap |
| Disallow | /sites/ |
| Disallow | /static/ |
| Disallow | /test |
| Disallow | /testing |
| Disallow | /topics/ |
| Disallow | /travelling-to* |
| Disallow | /upload/ |
| Disallow | /view-source* |
| Disallow | /who-is-shoe* |
| Disallow | /works/ |
| Disallow | /.git/ |
| Disallow | /go/ |
| Disallow | /*.gif$ |
| Disallow | /how-old-am-i-today/1953 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.agecalculator.org/sitemap.xml |