thebump.com
robots.txt

Robots Exclusion Standard data for thebump.com

Resource Scan

Scan Details

Site Domain thebump.com
Base Domain thebump.com
Scan Status Ok
Last Scan2024-11-09T16:34:26+00:00
Next Scan 2024-11-16T16:34:26+00:00

Last Scan

Scanned2024-11-09T16:34:26+00:00
URL https://thebump.com/robots.txt
Redirect https://www.thebump.com/robots.txt
Redirect Domain www.thebump.com
Redirect Base thebump.com
Domain IPs 23.215.7.28, 23.215.7.6, 2600:1413:b000:1b::17d7:706, 2600:1413:b000:1b::17d7:71c
Redirect IPs 23.215.7.28, 23.215.7.6, 2600:1413:b000:1b::17d7:706, 2600:1413:b000:1b::17d7:71c
Response IP 23.52.40.8
Found Yes
Hash e998391c6b35fcb98997ae762afcc0552436240dbce178664c24724e6f80ffda
SimHash aa421e44af11

Groups

*

Rule Path
Disallow /login
Disallow /search
Disallow /calendar/
Disallow /more
Disallow /header_and_footer/
Disallow /b/most-popular-baby-names-2020
Disallow /b/search

magpie-crawler

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.thebump.com/sitemap_index.xml

Comments

  • Updated on 05/26/22
  • Baby Names