unit.co
robots.txt

Robots Exclusion Standard data for unit.co

Resource Scan

Scan Details

Site Domain unit.co
Base Domain unit.co
Scan Status Ok
Last Scan2024-06-03T00:55:14+00:00
Next Scan 2024-07-03T00:55:14+00:00

Last Scan

Scanned2024-06-03T00:55:14+00:00
URL https://unit.co/robots.txt
Redirect https://www.unit.co/robots.txt
Redirect Domain www.unit.co
Redirect Base unit.co
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 18.155.68.14, 18.155.68.2, 18.155.68.8, 18.155.68.91, 2600:9000:23d2:3000:e:d439:5580:93a1, 2600:9000:23d2:4400:e:d439:5580:93a1, 2600:9000:23d2:5200:e:d439:5580:93a1, 2600:9000:23d2:6600:e:d439:5580:93a1, 2600:9000:23d2:9000:e:d439:5580:93a1, 2600:9000:23d2:aa00:e:d439:5580:93a1, 2600:9000:23d2:d200:e:d439:5580:93a1, 2600:9000:23d2:fc00:e:d439:5580:93a1
Response IP 18.155.68.2
Found Yes
Hash ef7c8fca13de538231435a1d93330bbfcb0737a197a904c84d7ab37c4c3b0469
SimHash 68010c008992

Groups

*

Rule Path
Disallow /landing-page/*
Disallow /chat-with-an-expert

Other Records

Field Value
sitemap https://www.unit.co/sitemap.xml