|
|
ce1213cd14
|
build robots.txt from ai.robots.txt on github
|
2024-08-04 17:33:37 -05:00 |
|
|
|
ff4c91e6f6
|
generate robots.txt from darkvisitors api
|
2024-07-29 20:08:19 -05:00 |
|
|
|
94678c36fe
|
fix sitemap url
|
2024-07-03 12:21:42 -05:00 |
|
|
|
f254f42d0c
|
final robots.txt tweak (for now)
|
2024-06-11 12:25:29 -05:00 |
|
|
|
ac981d3572
|
tweak robots.txt again again
|
2024-06-11 12:17:28 -05:00 |
|
|
|
dc22adf427
|
tweak robots.txt again
|
2024-06-11 12:07:18 -05:00 |
|
|
|
2dede53aa5
|
tweak robots.txt
|
2024-06-11 12:04:28 -05:00 |
|
|
|
c0c824a01e
|
let ai bots know they aren't welcome
|
2024-04-12 15:29:07 -05:00 |
|
