Can we start a sentence with “and” or “but”?

Can a sentence correctly begin with the conjunctions “and” or “but,” and how does this usage differ between formal and informal English?