In order to secure this location the Hebrews must dispossess a remnant of the Canaanites, who held a fortified position on the mountains of Zion and Moriah. This stronghold was called Jebus, and its inhabitants were known as Jebusites. For centuries Jebus had been looked upon as impregnable; but it was besieged and taken by the Hebrews under the command of Joab, who, as the reward of his valor, was made commander-in-chief of the armies of Israel. Jebus now became the national capital, and its heathen name was changed to Jerusalem.

Hebræerne kunne imidlertid ikke tage byen i besiddelse, før de havde fordrevet de sidste af kanaanæerne, som havde forskanset sig på Zions og Morijas Bjerg. Deres fæstning hed Jebus, og indbyggerne her kaldtes jebusitterne. Jebus var i århundreder blevet anset for at være uindtagelig, men hebræerne belejrede og indtog den under anførsel af Joab, der som belønning for sin tapperhed blev gjort til øverstbefalende for Israels hære. Nu blev Jebus gjort til nationens hovedstad, og byens hedenske navn blev ændret til Jerusalem.