Confounding factors include other terminology, other name matches:
"New York" frequently appears in reference to newspapers or cities:
new york times: 98
new york city: 55
So adjusted NY score: 163
"Washington" is even harder to disambiguate, as it may refer to the state, city (DC), as a topnym for the US / US Government, etc., It's challenging to identify these textually, though the newspaper and monument mentions can be identified:
washington post: 16
washington times: 1
washington monument: 1
Adjusted WA score: 55. And is probably lower.
California is often mentioned by toponym (e.g., "silicon valley", region (bay area), or specific cities (SF, LA, etc.). I'm NOT going to adjust for these but do note the following major occurences:
silicon valley: 399
bay area: 65
california ave: 2
There are a few other more minor examples such as "kansas city" (confounding "kansas"), "oklahoma city", and "iowa city", though those don't affect top results.
(This excludes the NYC burough of Manhattan, which gets 36 mentions itself, nudging out LA.)
I've also got a list of most-featured front-page sites, with the ten most frequent being: nytimes.com, techcrunch.com, arstechnica.com, bloomberg.com, wired.com, wsj.com, youtube.com, wikipedia.org, BBC (as both bbc.com and bbc.co.uk), and theguardian.com. The mean votes and comments for each are interesting, with Bloomberg topping by both average vote (255.46) and comments (178.04), from the top-10. (There are obviously sites with much higher mean scores but less frequent appearance, including singletons).
I've broken submitters by freqency, points, and comments as well, with 43,745 submitters accounting for the stories analised. The long-absent nickb tops front-page appearances at 1,322, followed by ingve (1,177) and tosh (679). I've apparently landed 60 front-page submissions averaging 329.00 points and 147.52 comments (both fairly respectable --- I'm apparently not submitting total tosh).
I'm still updating my code and checking data (and found a couple of glitches writing out the above, e.g., whatever I'd done to tabulate city mentions didn't work). Data exist presently in flatfiles, I'm thinking of dumping to sqlite for possibly easier/faster analysis.
A rough and preliminary look at countries represented in front-page titles, again with numerous issues:
"Cuba" often appears as "Mark Cuban", Jordan is the country most often confounded with a major celebrity and/or IT/tech personality ("Michael Jordan" and "Jordan Hubard" respectively), "Mali" is most likely to be confused with a car or AMD chipset, the United States has multiple possible references (US, U.S., USA, U.S.A., America, American), some of which are confounded (e.g., "North America"). But this provides a rough sense.
Analysis is largely awk, grep, sort, uniq --- standard shell tool stuff. Amazingly powerful though really. Crawl via wget which performed wonderfully as usual. Thanks to HN/YC for not throttling too aggressively.
Tuesday and Wednesday typically see most engagement. Biggest fall-off is Saturday.
On the other hand, if you want a chance of your submission making the front page, weekends are probably a better bet. (My data don't show this, mind, as they don't show all submissions for a day, but this tends to support my hunch / general sense in my own submissions.)
It's interesting to note that Tuesday and Wednesday have generally captured the top spot, but there was a notable fall-off in Wednesday's standing in the Covid era. Not entirely unprecedented (Wed. lagged Tues. by 10 votes (points) in 2014, for example), but it catches my eye.
There's also the long-term trends in votes and comments over the years:
Total stories: 178,072 (Should match 5,939 days * 30 stories, seems to come a bit short with 98 fewer stories than expected.)
- States mentioned: 50 (mentions: 1,344)
- Cities mentioned: 109 (checked against list of 330 largest US cities, plus a few additions of my own).
- Sites submitted: 52,687
Top 20 states by raw string-match (this is adjusted below for some overstatements):
Confounding factors include other terminology, other name matches:"New York" frequently appears in reference to newspapers or cities:
So adjusted NY score: 163"Washington" is even harder to disambiguate, as it may refer to the state, city (DC), as a topnym for the US / US Government, etc., It's challenging to identify these textually, though the newspaper and monument mentions can be identified:
Adjusted WA score: 55. And is probably lower.California is often mentioned by toponym (e.g., "silicon valley", region (bay area), or specific cities (SF, LA, etc.). I'm NOT going to adjust for these but do note the following major occurences:
There are a few other more minor examples such as "kansas city" (confounding "kansas"), "oklahoma city", and "iowa city", though those don't affect top results.Adjusted top-5 state rankings:
So, answering the original question, Colorado is the fifth-most-loved front-page state.The 10 least-represented states:
Top-10 US city-name mentions (see confounding factors above): (This excludes the NYC burough of Manhattan, which gets 36 mentions itself, nudging out LA.)I've also got a list of most-featured front-page sites, with the ten most frequent being: nytimes.com, techcrunch.com, arstechnica.com, bloomberg.com, wired.com, wsj.com, youtube.com, wikipedia.org, BBC (as both bbc.com and bbc.co.uk), and theguardian.com. The mean votes and comments for each are interesting, with Bloomberg topping by both average vote (255.46) and comments (178.04), from the top-10. (There are obviously sites with much higher mean scores but less frequent appearance, including singletons).
I've broken submitters by freqency, points, and comments as well, with 43,745 submitters accounting for the stories analised. The long-absent nickb tops front-page appearances at 1,322, followed by ingve (1,177) and tosh (679). I've apparently landed 60 front-page submissions averaging 329.00 points and 147.52 comments (both fairly respectable --- I'm apparently not submitting total tosh).
I'm still updating my code and checking data (and found a couple of glitches writing out the above, e.g., whatever I'd done to tabulate city mentions didn't work). Data exist presently in flatfiles, I'm thinking of dumping to sqlite for possibly easier/faster analysis.
A rough and preliminary look at countries represented in front-page titles, again with numerous issues:
"Cuba" often appears as "Mark Cuban", Jordan is the country most often confounded with a major celebrity and/or IT/tech personality ("Michael Jordan" and "Jordan Hubard" respectively), "Mali" is most likely to be confused with a car or AMD chipset, the United States has multiple possible references (US, U.S., USA, U.S.A., America, American), some of which are confounded (e.g., "North America"). But this provides a rough sense.Analysis is largely awk, grep, sort, uniq --- standard shell tool stuff. Amazingly powerful though really. Crawl via wget which performed wonderfully as usual. Thanks to HN/YC for not throttling too aggressively.