faceipf.com
robots.txt

Robots Exclusion Standard data for faceipf.com

Resource Scan

Scan Details

Site Domain faceipf.com
Base Domain faceipf.com
Scan Status Ok
Last Scan2024-06-03T20:35:14+00:00
Next Scan 2024-06-17T20:35:14+00:00

Last Scan

Scanned2024-06-03T20:35:14+00:00
URL https://faceipf.com/robots.txt
Redirect https://www.gene.com/robots.txt
Redirect Domain www.gene.com
Redirect Base gene.com
Domain IPs 104.18.2.77, 104.18.3.77, 2606:4700::6812:24d, 2606:4700::6812:34d
Redirect IPs 104.18.20.119, 104.18.21.119, 2606:4700::6812:1477, 2606:4700::6812:1577
Response IP 104.18.20.119
Found Yes
Hash 7563d148b6ac662a985f5ccfca430d3e4810591a104570298afd4e177d39cdc5
SimHash 251450401312

Groups

*

Rule Path
Disallow /*.json
Disallow /scientists/mta/*
Disallow /about-us/suppliers/supplier-registration/*
Disallow /meta/search*
Disallow /careers/find-a-job?*
Disallow /assets/frontend/downloads/media/fs18/*
Disallow /download/pdf/nocrawl/*