Call & make that report. Also call Social Services. This lady obviously needs help of some kind. Everyone 'taking care of her problems' by ignoring them are NOT solving the problem.
Short story about dementia:
A friend's mother was living with him because he didn't want to put her in a home. She had been diagnosed with dementia. One day while he was at work, she burned down his kitchen because she forgot she was cooking. Another day, when he came home from work, she had found an iron pipe somewhere and clocked him over the head with it when he opened his door. She didn't know who he was and thought someone was breaking into the apartment. Most people will tell you that dementia patients are not violent or dangerous. But they CAN be. If they feel threatened they may feel that they need to protect themselves. But their ability to know if they really are threatened or not is compromised. Bill opening his front door wasn't a threat, but his mom sure thought it was and reacted as if it were.
So, I suppose that lady with the baby goose in her bra had every reason to feel threatened when you showed up with a gun in your hand. I'm not saying to ever investigate anything suspicious without being able to protect yourself. But this lady needs help, and obviously anyone who CAN help her doesn't know it yet.
I know if this were my mom (aunt, grandma, whatever), I would hope someone would take the time to make a report so that her problems could be addressed, before something bad happens.
I would also put locks on all the doors.