Most of the reason I never kept up with blogging in the beginning is because I wasn't blogging about my niche. I enjoy crafting and organizing which is what my first posts were about. But my mind is constantly on teaching so when I started blogging about teaching...things changed. I enjoy blogging so much more now that I get to share what's on my brain...all.the.time!
The best way to build your own followers and relationships is to follow and comment on other blogs. Especially blogs that are similar to yours! I also have found it easier to build relationships through other social medias, like Instagram! It allows you to get to know the person behind the blog a little better. So follow people on other social media sites too! Commenting is very important too! If you enjoyed what you read, then tell them!!
Finally, don't worry about the numbers. I know, I know, it's hard not to. But with so many bloggers out there, it can be tough at first. Building relationships will help with the numbers! Slow and steady wins the race!
I'm not sure if I can call them my BBB's (Best Blogging Buddies), because I don't know if it's reciprocal.