Lucius was imprisoned in Azkaban and, even after he is free, was treated as a disgrace and a failure by Voldemort and the other
Why? The main reason is that Lucius failed to retrieve the prophecy from the Ministry of Magic, put that on top of all the other times Lucius failed, and it leads to him losing any clout he once carried within the Death Eaters.
Although he broke Lucius out of Azkaban in 1997, along with many other Death Eaters, Voldemort treated him with disdain, taking over his home and his wand, and mocking the Malfoys for their relation to a werewolf through Narcissa's niece.
It's mainly because of how far from his grace Lucius had fallen. The Riddle diary destroyed, the loss of Dobby, the prophecy quest failed, his son unable to kill Dumbledore, the escape from Malfoy mansion and now the apparent despair of his suggestion. Voldemort regarded him even less than Wormtongue at that point.
Voldemort didn't hate Lucius Malfoy, he despised him for his failure. Lucius's fall from grace is a study in irony. During the Second Wizarding War, Lucius was Voldemort's Chief Death Eater; but afterwards, everything went downhill for him.
Narcissa's greatest moment, however, was when she chose to betray Voldemort in Harry Potter and the Deathly Hallows. Not knowing whether Draco was alive or dead, Narcissa chose to lie to the Dark Lord rather than risk losing her son.
He was more jealous of Harry than he let on
Specifically, Draco was jealous of Harry. It was easy to miss because Draco didn't often show his emotions, modelling himself on his cold, confident, calculating father, but J.K. Rowling has confirmed that a lot of his enmity towards Harry stemmed from envy.
Voldemort hugged Draco as an improvisation and it wasn't planned. Even Tom Felton (Draco Malfoy) was caught unaware which increased the effect. In Harry Potter style, it was like a welcome for Draco, but as Voldemort had never known love, he didn't know how to hug him very well. Thats why they had the awkward hug.
After Voldemort's downfall on the fateful night of Halloween in 1981, many Death Eaters are captured, but Lucius avoids being imprisoned by claiming that he was under the Imperius Curse throughout the war. He manages to retain his position among the social elite, but still remains a power-hungry bigot.
According to Harry Potter: The Wand Collection (your canon mileage may vary) Lucius did intend to kill Harry using Avada Kedavra prior to Dobby stopping the act... Lucius is a known practitioner of the Dark Arts with his wand, including Unforgivable Curses.
Isaacs brings up Lucius' disheveled appearance in Deathly Hallows, raising the possibility that the Malfoy patriarch had begun drinking too much. The way Isaacs saw it, Lucius was in a no-win situation. Given everything he'd done, the man no longer had a place on either side of the war.
Lucius Malfoy did nothing to dispel this hateful impression and was a fully signed up supporter of pure-blood supremacy. In fact, he was in Lord Voldemort's closest circle as a Death Eater. He despised Muggles, Muggle-borns, those he saw as blood traitors and tried to instil those values in his family.
Also they were highly unsure if their wand worked according to Voldemort's wishes and they would have to face huge repercussions if it failed to do so. Hence , Lucius Malfoy was scared to give away his wand to The Dark Lord.
1. Couldn't Stand: Harry. At first, the reason Voldemort hated Harry was because of the prophecy. It foretold of a boy who was destined to defeat him.
While disguised as Moody, Crouch attacks Draco by turning him into a ferret. Initially, this comes across as a gesture of goodwill as “Moody” says he did it because Draco was going to curse Harry behind his back.
Lucius was imprisoned in Azkaban and, even after he is free, was treated as a disgrace and a failure by Voldemort and the other Death Eaters. In summary, Lucius is on Voldemort's bad side because: he failed to obtain the prophecy for Voldemort. he exposed the secret of Voldemort's return.
As a result, Voldemort was increasingly dismissive towards Lusicus and his whole family, culminating in the Battle of Hogwarts in Harry Potter and the Deathly Hallows - Part 2, where the Malfoys at long last renounced their allegiance to the Dark Lord and defected to the good side.
When Lucius turns on Voldemort due to the reveal of his Horcruxes, Narcissa divorces him, taking 75% of Malfoy's wealth with her.
The Malfoys didn't go to Azkaban mainly because at the end of the day, they put their family over Voldemort.
Draco's refusal to reveal Harry's identity to Bellatrix was not because he liked him. It was because he believed that Harry was the only chance they had at defeating Voldemort. At first, Draco admired and revered Voldemort until he threatened his family's safety.
“Harry was constantly crushing on Draco. He just couldn't hide it.” In the books and movies, Harry and Draco are constantly at each other's throats, given that Draco's parents are Voldemort supporters and the evil wizard killed Harry's parents.
She made sure HE was safe - putting THEIR LIVES at risk to save his - before they escaped. And yet while Bellatrix tortured Hermione, Draco did nothing. Because he was a weak-willed fraction of a human being who deserves nothing but contempt.
Draco Malfoy's mother Narcissa was cold, cunning and devoted to the Dark Lord. But she was also a mother, which meant she was willing to risk everything to make sure her son was safe. When Harry survived Voldemort's Killing Curse for the second time, Narcissa pretended he was dead so she could get to Draco.
Voldemort intentionally made six Horcruxes, but when he used Avada Kedavra on Harry, he unintentionally created a seventh Horcrux. Instead of dying, Lily's love for Harry created a counter 'curse' known as Sacrificial Protection and saved Harry.
Lucius Malfoy craved authority and recognition. Nothing pleased him more than to contribute to a foundation and be elected to its board; nothing made him happier than to walk down the street and have magical folk either kiss up to him or duck their heads and cross the street. Arthur Weasley did neither.