As understood historically, this was often treated as the question whether math could be reduced to logic, that is, derived using only logical concepts, principles, rules of inference. This hypothesis was first suggested by Gottfried Leibniz in the 18th century. read more
Math can be derived using logic, but you need to start from axioms. In logic, to derive something is to follow the allowed mechanical rules from your premises to your conclusion. In mathematics, those premises are called axioms, and there are a few sets of axioms that allow you to build up a system that looks like math. read more
But the construction and definition of this"theory," and our arguments to conclude that this theory $\textit{works}$, can't, of course, be based on any rigorous system; it is the $\textit{first}$ and $\textit{basic}$ rigorous system. read more