Mr Miller was the architect of some of the last administration's most controversial immigration plans, including the child separation policy, the Muslim ban and the use of military money to build the border wall.
Burning sage has long been used by indigenous peoples in ceremonies meant to cleanse spaces from negativity and to promote healing.
Alongside the sage, which was reported by the New York Times, Ms Rice has also reportedly hung a painting made by a Haitian artist depicting a group of Black individuals in colourful clothing walking on a street.
Ms Rice will take a leading role in Mr Biden's immigration policies.
She said on 3 February that the administration would form a task force with the purpose of reuniting the 3,000 children separated from their families under the Trump-era policy.
That was the same month that Mr Biden's administration was criticised for re-opening a Trump-era border detention facility to house children of migrants.
In response to the criticism, Ms Rice recently led a Biden administration trip to tour a Department of Homeland Security Border Patrol facility and a Health and Human Services Office of Refugee Resettlement centre.
The visiting officials discussed capacity needs at the facilities.
Ms Rice formerly served as Barack Obama's national security advisor and faced fierce scrutiny from Republicans in the wake of the Benghazi attack that left four Americans dead.
Join our new commenting forum
Join thought-provoking conversations, follow other Independent readers and see their replies