agecalculator.org
robots.txt

Robots Exclusion Standard data for agecalculator.org

Resource Scan

Scan Details

Site Domain agecalculator.org
Base Domain agecalculator.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-10T15:13:44+00:00
Next Scan 2024-06-17T15:13:44+00:00

Last Successful Scan

Scanned2024-06-02T15:12:36+00:00
URL https://agecalculator.org/robots.txt
Redirect https://www.agecalculator.org/robots.txt
Redirect Domain www.agecalculator.org
Redirect Base agecalculator.org
Domain IPs 104.21.28.74, 172.67.144.186, 2606:4700:3031::ac43:90ba, 2606:4700:3036::6815:1c4a
Redirect IPs 138.199.46.68, 2400:52e0:1500::868:1
Response IP 138.199.46.68
Found Yes
Hash 80ed32501abb853ba0a4d415646d117c16852b4559e347376a4abb01aca63bab
SimHash 19607526e491

Groups

*

Rule Path
Disallow
Disallow /_ignition/
Disallow /_profiler/
Disallow /.env
Disallow /wiki/
Disallow /*wp-includes/
Disallow /*site/
Disallow /*sito/
Disallow /0000*
Disallow /0byte
Disallow /*.php
Disallow /*.aspx
Disallow /*.css
Disallow /*.js
Disallow /123
Disallow /404_icon.png
Disallow /*net-worth*
Disallow /admin/
Disallow /assets/
Disallow /.well-known/
Disallow /backup
Disallow /bk
Disallow /celebrity*
Disallow /club/
Disallow /cms/
Disallow /core/
Disallow /css/
Disallow /data/
Disallow /tags/
Disallow /dev
Disallow /e/
Disallow /emma*
Disallow /en/
Disallow /everything-you-need*
Disallow /fileupload/
Disallow /fonts/
Disallow /go/
Disallow /health/
Disallow /history/
Disallow /home
Disallow /index
Disallow /js/calendar/
Disallow /js/slick/
Disallow /label/
Disallow /michael*
Disallow /news/
Disallow /newsite
Disallow /page/
Disallow /pagenotfound.html
Disallow /person/
Disallow /poets/
Disallow /public/
Disallow /ro-khanna-height/
Disallow /robert-duvall-net-worth/
Disallow /sections/
Disallow /server/
Disallow /sitemap
Disallow /sites/
Disallow /static/
Disallow /test
Disallow /testing
Disallow /topics/
Disallow /travelling-to*
Disallow /upload/
Disallow /view-source*
Disallow /who-is-shoe*
Disallow /works/
Disallow /.git/
Disallow /go/
Disallow /*.gif$
Disallow /how-old-am-i-today/1953

Other Records

Field Value
sitemap https://www.agecalculator.org/sitemap.xml