Low Temp/Thyroid

not TTC yet but concerned for when we will be. we use NFP so i chart and my temps are always low - around 96 (we even switched thermometers to make sure it wasnt broken). i have heard can be an early sign of a thyroid prob (which runs in the fam) but drs keep saying tests dont show anything.
has anyone had any problems like this?