I did waste about 20 minutes trying to do a recursive link following crawl (to write each rendered page to file), because Opus wanted to write a ruby task to do it. It wasn’t working so I googled it and found out link following is a built in feature of cURL…
I catch enough of these weird things where I don’t fully understand why it chose to do something, but understand that there’s a simpler way, where I tend to be skeptical of using it for anything I couldn’t do myself but am just too lazy to go in and punch the keys for. On that front, it’s great
I did waste about 20 minutes trying to do a recursive link following crawl (to write each rendered page to file), because Opus wanted to write a ruby task to do it. It wasn’t working so I googled it and found out link following is a built in feature of cURL…