Interestingly, this morning it worked.
Now, I did go to wordpress.com, log in there, and view notifications from across blogs using the dropdown at wordpress.com.
After doing that, the notifications started working fine, across all blogs.
Maybe the user needs to have viewed notifications at wordpress.com at least once, or something? I do not often go to wordpress.com, I usually go directly to my self-hosted blog dashboards.