Brutkey

John Timaeus
@johntimaeus@infosec.exchange

So what am I doing on my birthday weekend?

Herding a very large webscrape.
It got stuck on the live video at cnn.com.
Killing the wget broke the scraper process.
Had to hack out a bunch of the sanity checks in topgen-scrape.sh to get it running again.


da_667
@da_667@infosec.exchange

@johntimaeus@infosec.exchange Happy b-day, friend.

John Timaeus
@johntimaeus@infosec.exchange

@da_667@infosec.exchange
I'm gonna end up rewriting topgen-scrape before this is done.
It's very elegant, minimalist bash. But if there's a continuous video feed it hangs hard.

Not good when cnn.com is line 60 of 328