airtable.com
robots.txt
Robots Exclusion Standard data for airtable.com
Resource Scan
Scan Details
| Site Domain | airtable.com |
| Base Domain | airtable.com |
| Scan Status | Ok |
| Last Scan | 2024-11-04T22:32:45+00:00 |
| Next Scan | 2024-11-18T22:32:45+00:00 |
Last Scan
| Scanned | 2024-11-04T22:32:45+00:00 |
| URL | https://airtable.com/robots.txt |
| Domain IPs | 174.129.103.97, 2600:1f18:7473:c20b:2093:c078:71e9:7c51, 2600:1f18:7473:c20b:6a13:1bf7:6e3f:cfbd, 2600:1f18:7473:c20c:a0bc:4170:95df:fc56, 2600:1f18:7473:c20d:18a9:95b8:86a8:36a6, 2600:1f18:7473:c20d:ede6:84ad:4928:306e, 2600:1f18:7473:c20d:fca9:4ecd:40ab:2462, 2600:1f18:7473:c212:3c1d:39f5:ea1:92, 2600:1f18:7473:c212:45f4:e1a4:83df:a5d9, 3.220.203.239, 3.233.53.144, 34.202.252.143, 44.198.7.198, 52.54.246.171, 54.86.193.66, 54.92.138.173 |
| Response IP | 44.220.13.217 |
| Found | Yes |
| Hash | fa9d2936becf58658a3333143f288848a4c09c066df7787b6cb764e796ae0247 |
| SimHash | 691c9038e790 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /404 |
| Disallow | /500 |
| Disallow | /auth |
| Disallow | /embed/* |
| Disallow | /temporary_marketing_proxy/* |
| Disallow | /forgot |
| Disallow | /internal/* |
| Disallow | /invite/l?inviteId=*&inviteToken=* |
| Disallow | /msa |
| Disallow | /shr* |
| Disallow | /sso/login |
| Disallow | /tbl* |
| Disallow | /?try=* |
| Disallow | /*?referralCode=* |
| Disallow | /?utm_source=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://airtable.com/sitemap.xml |