Kenny Jackett, now the longest serving Championship manager, has seen his side go seven games without a win but he saw positives from the last game at Watford even though they were beaten.
"We had a very good spirit at Watford and we ran them very close," he said. "It was a better all-round team performance, but we need to find goals and the right link up front because that hasn't been there for a number of weeks now.
"We know what we need to find and, if we can find that and keep the type of spirit we had on Tuesday night, then we can look forward optimistically."
Eddie Howe came home from Peterborough two weeks ago having seen his side suffer a 2-1 defeat in another poor performance, but he's much more upbeat three home games later with a cup win and four points, including one against league leaders Southampton.
Looking forward to Millwall, he said: "We have had three positive performances and now we are looking to take that on into the away game. I have said all along that football can change very quickly. After the Peterborough game everybody was disappointed but we have bounced back pretty well.
"The key now is the consistency and to repeat those three performances week-in, week-out. That's what we are looking to do.
"Hopefully away from home we are going to be as positive as we have been in the last three home games. The result on Tuesday was great but we need to back it up with another performance. Our away form is going to be as important as our home form. We want to be strong on the road this year."
He continued: "To get your team how you want it and playing exactly how you want it takes a while. We are evolving, but we are moving in the right direction and there have been really positive signs and excellent performances from the players. The attitude and the intensity we played with (on Tuesday) was really pleasing.
"Millwall is always a tough place to go and they can make it difficult for you. You know you have to fight and battle for everything you get there. You are not going to be given anything but we are looking forward to it on the back of Tuesday and we can't wait for the game now.
"If you look at the league table a couple of wins and you are right up there. It's important that we pick up points at this stage of the season. What you don't want to do is leave yourself too much to do."