pge.com
robots.txt

Robots Exclusion Standard data for pge.com

Resource Scan

Scan Details

Site Domain pge.com
Base Domain pge.com
Scan Status Ok
Last Scan2024-10-29T19:44:43+00:00
Next Scan 2024-11-28T19:44:43+00:00

Last Scan

Scanned2024-10-29T19:44:43+00:00
URL https://pge.com/robots.txt
Redirect https://www.pge.com/robots.txt
Redirect Domain www.pge.com
Redirect Base pge.com
Domain IPs 23.32.29.17, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:711, 96.17.180.49
Redirect IPs 23.32.29.17, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:711, 96.17.180.49
Response IP 96.17.180.49
Found Yes
Hash 66e089fc2bfadcc54a0d7f2deece912d77aa84477e61544ef21c8fcb834fd26f
SimHash 4c04c4e86b1b

Groups

ninjabot
w3c-checklink

Rule Path
Allow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /mobile/
Disallow /mobile_jbri/

Other Records

Field Value
sitemap https://www.pge.com/en.sitemap.xml
sitemap https://www.pge.com/es.sitemap.xml
sitemap https://www.pge.com/pt.sitemap.xml
sitemap https://www.pge.com/ko.sitemap.xml
sitemap https://www.pge.com/ja.sitemap.xml
sitemap https://www.pge.com/zh.sitemap.xml
sitemap https://www.pge.com/ar.sitemap.xml
sitemap https://www.pge.com/vi.sitemap.xml
sitemap https://www.pge.com/fa.sitemap.xml
sitemap https://www.pge.com/hi.sitemap.xml
sitemap https://www.pge.com/ru.sitemap.xml
sitemap https://www.pge.com/th.sitemap.xml
sitemap https://www.pge.com/tl.sitemap.xml
sitemap https://www.pge.com/pa.sitemap.xml
sitemap https://www.pge.com/km.sitemap.xml
sitemap https://www.pge.com/hmn.sitemap.xml
sitemap https://www.pge.com/tariffs/en.sitemap.xml