I traced the poem fragment to "Labor" by Frances Sargent Osgood. Osgood (1811-1850) was pals with Edgar Allan Poe:
Oddly, Poe's wife Virginia approved of the relationship and often invited Osgood to visit their home. Virginia believed their friendship had a "restraining" effect on her husband. Poe had given up alcohol to impress Osgood, for example. Virginia may also have been aware of her own impending death and was looking for someone who would take care of Poe. Osgood's husband Samuel also did not object, apparently used to his wife's impetuous behavior; he himself had a reputation as a philanderer.