It’s not a phobia […]

For the sake of argument, Merriam-Webster defines the “phobia” suffix as:

intolerance or aversion for ^[1]

as well as

exaggerated fear of ^[1]

That being said, one can define a words however they wish — imo, all that matters is that those engaged in a conversation together all use the same definitions. If you would like to reserve the “phobia” suffix to represent only “exaggerated fear of”, what would you propose in its stead to represent “intolerance or aversion for”?