But the short answer to your question (speaking as an atheist) would be, no. You "tend to agree" with the atheists here, because the default position on most elements of religious doctrine taken by atheists is, in fact, broadly agreed with by moderate believers in all the major religions! The vast majority of Jews, Christians and Muslims have no difficulty whatsoever reconciling their belief in God with a belief in Evolution (let's say) and think of Genesis 1 as only a folk myth. They can see that clinging to the writings or statements of people who were educated to a previous, lower, level of human knowledge, is intrinsically irrational. At the same time, even an atheist like myself can appreciate the Wisdom of the ancients, as well as the beauty of some of the writing itself, or of the depth of thought which produced items like the Book of Job, for instance.
There isn't anything in the Bible to compel one to a religious view. There isn't anything in the rejection of parts, or even the whole, of the Bible that compels one to a completely non-religious view. You have to go with what you yourself believe.
Jesus said, "Love your neighbour as yourself." That is a great philosophy whatever you believe.