Bit of column A, bit of column B.
They’re easy to catch/kill and chase off, yeah. And they’re usually not that much of a problem for humans, unless you get that venom in your eyes(for example, while killing one), or you eat one or something. So, uh, don’t.
On the other hand, they’re extremely destructive environmental pests, killing local wildlife both as predators(other frogs and toads, insects, etc), and prey(if a carnivorous animal eats one, they’ll often die). If you have a dog or cat, you have to keep an eye out and keep them out of your yard, because if your dog/cat eats one, there’s a decent chance they’ll die, depending on the size of the animal.
They might not be harmful to humans specifically, but there’s good reasons we kill them on sight.