Difference between revisions of "Protocol FAQ"

From wiki.vg
Jump to navigation Jump to search
(→‎I think I've done everything right, but…: Contrary to what was written, 1.20.4 no longer treats Set Default Spawn Position specially. Update packet names.)
(→‎Offline mode: Encryption is possible in offline mode now)
 
(16 intermediate revisions by 5 users not shown)
Line 1: Line 1:
People very, very often have questions regarding the Minecraft Modern [[Protocol]], so we'll try to address some of the most common ones on this document. If you're still having trouble, join us on IRC, channel [ircs://irc.libera.chat:6697/mcdevs #mcdevs on irc.libera.chat].
+
People very, very often have questions regarding the Minecraft Modern [[Protocol]], so we'll try to address some of the most common ones on this document. If you're still having trouble, join us on our [https://discord.gg/Tf4xwK3Ke7 discord] or our IRC channel [ircs://irc.libera.chat:6697/mcdevs #mcdevs on irc.libera.chat].
  
 
== Is the protocol documentation complete? ==
 
== Is the protocol documentation complete? ==
Line 5: Line 5:
  
 
== What's the normal login sequence for a client? ==
 
== What's the normal login sequence for a client? ==
See [[Authentication]] for communication with Mojang's servers.
 
  
The recommended login sequence as of 1.20.4 looks like this, where '''C''' is the client and '''S''' is the server:
+
(This is about joining a Minecraft server. See [[Microsoft Authentication Scheme]] for how to log in to a Minecraft account, and [[Protocol Encryption]] for details on player authentication during server login.)
 +
 
 +
The recommended login sequence as of 1.21 looks like this, where '''C''' is the client and '''S''' is the server:
 
# Client connects to the server
 
# Client connects to the server
 
# '''C'''→'''S''': [[Protocol#Handshake|Handshake]] State=2
 
# '''C'''→'''S''': [[Protocol#Handshake|Handshake]] State=2
 
# '''C'''→'''S''': [[Protocol#Login Start|Login Start]]
 
# '''C'''→'''S''': [[Protocol#Login Start|Login Start]]
# '''S'''→'''C''': [[Protocol#Encryption Request|Encryption Request]]
+
# '''S'''→'''C''': [[Protocol#Encryption Request|Encryption Request]] (optional)
# Client auth
+
# Client auth (Only if server sent Encryption Request)
# '''C'''→'''S''': [[Protocol#Encryption Response|Encryption Response]]
+
# '''C'''→'''S''': [[Protocol#Encryption Response|Encryption Response]] (Only if server sent Encryption Request)
# Server auth, both enable encryption
+
# Server auth, both enable encryption (Only if server sent Encryption Request)
 
# '''S''' → '''C''': [[Protocol#Set Compression|Set Compression]] (Optional, enables compression)
 
# '''S''' → '''C''': [[Protocol#Set Compression|Set Compression]] (Optional, enables compression)
 
# '''S''' → '''C''': [[Protocol#Login Success|Login Success]]
 
# '''S''' → '''C''': [[Protocol#Login Success|Login Success]]
Line 22: Line 23:
 
# '''S''' → '''C''': [[Protocol#Clientbound Plugin Message (configuration)|Clientbound Plugin Message]] (Optional, [[Plugin channel#minecraft%3Abrand|<code>minecraft:brand</code>]] with the server's brand)
 
# '''S''' → '''C''': [[Protocol#Clientbound Plugin Message (configuration)|Clientbound Plugin Message]] (Optional, [[Plugin channel#minecraft%3Abrand|<code>minecraft:brand</code>]] with the server's brand)
 
# '''S''' → '''C''': [[Protocol#Feature Flags|Feature Flags]] (Optional)
 
# '''S''' → '''C''': [[Protocol#Feature Flags|Feature Flags]] (Optional)
# '''S''' → '''C''': [[Protocol#Registry Data|Registry Data]]
+
# '''S''' → '''C''': [[Protocol#Clientbound Known Packs|Clientbound Known Packs]]
 +
# '''C''' → '''S''': [[Protocol#Serverbound Known Packs|Serverbound Known Packs]]
 +
# '''S''' → '''C''': [[Protocol#Registry Data|Registry Data]] (Multiple)
 
# '''S''' → '''C''': [[Protocol#Update Tags (configuration)|Update Tags]] (Optional)
 
# '''S''' → '''C''': [[Protocol#Update Tags (configuration)|Update Tags]] (Optional)
 
# '''S''' → '''C''': [[Protocol#Finish Configuration|Finish Configuration]]
 
# '''S''' → '''C''': [[Protocol#Finish Configuration|Finish Configuration]]
Line 49: Line 52:
 
# '''S''' → '''C''': [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]] (One sent for each chunk in a circular area centered on the player's position)
 
# '''S''' → '''C''': [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]] (One sent for each chunk in a circular area centered on the player's position)
 
# '''S''' → '''C''': inventory, entities, etc.
 
# '''S''' → '''C''': inventory, entities, etc.
 +
 +
=== Offline mode ===
 +
If the Notchian server is in offline mode, it will not send the [[Protocol#Encryption Request|Encryption Request]] packet, and likewise, the client should not send [[Protocol#Encryption Response|Encryption Response]]. In this case, encryption is never enabled, and no authentication is performed.
 +
 +
Clients can tell that a server is in offline mode if the server sends a [[Protocol#Login Success|Login Success]] without sending [[Protocol#Encryption Request|Encryption Request]].
 +
 +
Versions 1.20.5 and newer support protocol encryption in offline mode, in which case the [[Protocol#Encryption Request|Encryption Request]] packet can be sent with Should Authenticate set to false, and both the client and server should not authenticate with Mojang. However, it's currently not possible to configure the Notchian server to do this.
  
 
== What does the normal status ping sequence look like? ==
 
== What does the normal status ping sequence look like? ==
Line 57: Line 67:
 
# '''C''' → '''S''': [[Protocol#Status Request|Status Request]]
 
# '''C''' → '''S''': [[Protocol#Status Request|Status Request]]
 
# '''S''' → '''C''': [[Protocol#Status Response|Status Response]]
 
# '''S''' → '''C''': [[Protocol#Status Response|Status Response]]
# '''C''' → '''S''': [[Protocol#Ping Request|Ping Request]]
+
# '''C''' → '''S''': [[Protocol#Ping Request (status)|Ping Request]]
# '''S''' → '''C''': [[Protocol#Pong Response|Pong Response]]
+
# '''S''' → '''C''': [[Protocol#Ping Response (status)|Ping Response]]
 
# Both sides close the connection
 
# Both sides close the connection
  
 
(Note that '''C''' is the Notchian client and '''S''' is the Notchian server).
 
(Note that '''C''' is the Notchian client and '''S''' is the Notchian server).
 
== Offline mode ==
 
If the server is in offline mode, it will not send the [[Protocol#Encryption Request|Encryption Request]] packet, and likewise, the client should not send [[Protocol#Encryption Response|Encryption Response]]. In this case, encryption is never enabled, and no authentication is performed.
 
 
Clients can tell that a server is in offline mode if the server sends a [[Protocol#Login Success|Login Success]] without sending [[Protocol#Encryption Request|Encryption Request]].
 
  
 
== I think I've done everything right, but… ==
 
== I think I've done everything right, but… ==
 
=== …my player isn't spawning! ===
 
=== …my player isn't spawning! ===
  
The Minecraft client will wait at the "Loading Terrain..." screen until late in the login sequence. As of 1.20.4, in order for the client to spawn, it must have received a [[Protocol#Game Event|Game Event]] packet with event 13 ("Start waiting for level chunks"), and at least one of the following conditions must be met:
+
The Minecraft client will wait at the "Loading Terrain..." screen until late in the login sequence. As of 1.21, in order for the client to spawn, it must have received a [[Protocol#Game Event|Game Event]] packet with event 13 ("Start waiting for level chunks"), and at least one of the following conditions must be met:
  
 
* The player is in a loaded chunk (sent via [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]]).
 
* The player is in a loaded chunk (sent via [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]]).
 
* The player is below the minimum world height or above the maximum world height (teleported via [[Protocol#Synchronize Player Position|Synchronize Player Position]]).
 
* The player is below the minimum world height or above the maximum world height (teleported via [[Protocol#Synchronize Player Position|Synchronize Player Position]]).
* The player in spectator mode.
+
* The player is in spectator mode.
 
* The player is dead (set via [[Protocol#Set Health|Set Health]] or [[Protocol#Combat Death|Combat Death]]).
 
* The player is dead (set via [[Protocol#Set Health|Set Health]] or [[Protocol#Combat Death|Combat Death]]).
 +
 +
The client will also spawn after spending 30 seconds in the loading screen, even if it never received Game Event 13.
  
 
In past versions, you could either (1.19.3 through 1.20.1) send the default spawn position packet or (pre-1.19.3) send the player position packet. In general, try sending packets that inform the client about the player's position in the world in order to get past the loading terrain screen.
 
In past versions, you could either (1.19.3 through 1.20.1) send the default spawn position packet or (pre-1.19.3) send the player position packet. In general, try sending packets that inform the client about the player's position in the world in order to get past the loading terrain screen.
  
As of 1.20.4, the minimum packets that need to be received and sent by the server in order to get the client past the loading terrain screen and into the world appear to be:
+
In version 1.21, it became required to send the known packs packet with <code>minecraft:core</code> version <code>1.21</code>.
 +
 
 +
As of 1.21, the minimum packets that need to be received and sent by the server in order to get the client past the loading terrain screen and into the world appear to be:
  
 
# Receive [[Protocol#Handshake|Handshake]]
 
# Receive [[Protocol#Handshake|Handshake]]
Line 86: Line 95:
 
# Send [[Protocol#Login Success|Login Success]]
 
# Send [[Protocol#Login Success|Login Success]]
 
# Receive [[Protocol#Login Acknowledged|Login Acknowledged]]
 
# Receive [[Protocol#Login Acknowledged|Login Acknowledged]]
# Send [[Protocol#Registry Data|Registry Data]]
+
# Send [[Protocol#Clientbound Known Packs|Clientbound Known Packs]]
 +
# Receive [[Protocol#Serverbound Known Packs|Serverbound Known Packs]]
 +
# Send multiple [[Protocol#Registry Data|Registry Data]]
 
# Send [[Protocol#Finish Configuration|Finish Configuration]]
 
# Send [[Protocol#Finish Configuration|Finish Configuration]]
 
# Receive [[Protocol#Acknowledge Finish Configuration|Acknowledge Finish Configuration]]
 
# Receive [[Protocol#Acknowledge Finish Configuration|Acknowledge Finish Configuration]]
Line 93: Line 104:
 
# Send [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]] and/or [[Protocol#Synchronize Player Position|Synchronize Player Position]] (see above)
 
# Send [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]] and/or [[Protocol#Synchronize Player Position|Synchronize Player Position]] (see above)
  
The most difficult part of this may be sending any necessary NBTs in the [[Protocol#Registry_Data|Registry Data]] packet. You will probably need to record one from the standard server and replay it. Or you can find someone who has done that already, for example in [https://gist.github.com/Norbiros/f604ce46821e68c50260a169a9921560 Norbiros' gist]. You can also find JSON representation of this packet in [https://github.com/PrismarineJS/minecraft-data/blob/master/data/pc/1.20.2/loginPacket.json PrismarineJS/minecraft-data repo on GitHub].
+
The most difficult part of this may be sending any necessary NBTs in the [[Protocol#Registry_Data|Registry Data]] packet. Note that if you tell the Notchian client you have 0 known packs, it will blatantly lie to you, so you will probably need to record one from the standard server and replay it. Or you can find someone who has done that already, for example in [https://gist.github.com/Norbiros/f604ce46821e68c50260a169a9921560 Norbiros' gist]. You can also find JSON representation of this packet in [https://github.com/PrismarineJS/minecraft-data/blob/master/data/pc/1.20.2/loginPacket.json PrismarineJS/minecraft-data repo on GitHub].
 
 
=== …my client isn't receiving complete map chunks! ===
 
''Main article: [[How to Write a Client]]''
 
 
 
The standard Minecraft server sends full chunks only when your client is sending player status update packets (any of [[Protocol#Player|Player (0x03)]] through [[Protocol#Player Position And Look|Player Position And Look (0x06)]]).
 
  
 
=== …chunks are randomly showing and disappearing! ===
 
=== …chunks are randomly showing and disappearing! ===
For newer clients, your server needs to send 49 chunks ahead of time, not just one. Send a 7×7 square of chunks, centred on the connecting client's position, ''before'' spawning them. Also, edge chunks sometimes bug a bit, try adding empty chunks with air around existing ones to prevent this issue.
+
The Notchian client only reliably renders chunks surrounded by other loaded chunks on all sides. See [[Chunk Format#Tips and notes]].
  
 
=== …the client is trying to send an invalid packet that begins with 0xFE01 ===
 
=== …the client is trying to send an invalid packet that begins with 0xFE01 ===
Line 109: Line 115:
 
The server is expected to send a [[Protocol#Keep Alive (clientbound)|Keep Alive]] packet every 1-15 seconds (if the server does not send a keep alive within 20 seconds of state change to Play, the client will disconnect from the server for '''Timed Out'''), and the client should respond with the serverbound version of that packet. If either party does not receive keep alives for some period of time, they will disconnect.
 
The server is expected to send a [[Protocol#Keep Alive (clientbound)|Keep Alive]] packet every 1-15 seconds (if the server does not send a keep alive within 20 seconds of state change to Play, the client will disconnect from the server for '''Timed Out'''), and the client should respond with the serverbound version of that packet. If either party does not receive keep alives for some period of time, they will disconnect.
  
=== ...my client isn't sending a Login Start packet! ===
+
=== ...some of the packets I expect to receive seem to be missing or too short ===
By default, the Notchian server and client may group packets depending on if Nagle's TCP algorithm is enabled - the primary objective of Nagle's algorithm is to reduce the total number of packets needed to be sent over the network, increasing the efficiency. Nagle's algorithm is achieved by delaying each TCP packet to check if there are any more that are about to be sent to group them. You may not see a Login Start packet as you may not have parsed anything past the packet's length, because of this, you'll need to separate packets based off of the packet length.
+
 
 +
You may be misusing the socket API. In particular, it is invalid to assume that the amount of data returned by calls to <code>recv</code> (or equivalent, depending on the API you're using) relates to packet boundaries in any way. There are no "borders" in a [[wikipedia:Transmission Control Protocol|TCP]] data stream, only bytes. Regardless of how any two consecutive packets are sent, the receiver may get one packet, then the other, both at once, half of one, then the rest of both, or any other permutation of buffer sizes adding up to the total size of the packets. The only correct way to know where one packet ends and another begins is the packet length field, and you need to be prepared to handle multiple packets in one buffer, packets split across multiple buffers, etc. (as well as length fields split across multiple buffers!)
 +
 
 +
Similarly, depending on the API being used, a <code>send</code> call may also not guarantee that its whole input buffer is sent (consult the relevant documentation for details). This may also cause the connection to appear to hang during the login process, since the server will be left waiting indefinitely for the rest of the packet to arrive.
 +
 
 +
One reason why packets sent separately may arrive at once is [[wikipedia:Nagle's algorithm|Nagle's algorithm]], a feature of many TCP implementations intended to improve efficiency particularly for applications making lots of small <code>send</code> calls. It is not the ''only'' reason, though, and disabling it should not be seen as a solution to the problem discussed here. Nonetheless, the delays it introduces are detrimental to real-time applications like Minecraft, so the Notchian client and server disable it, and you should too. This is typically done by enabling a socket option called <code>TCP_NODELAY</code>. Especially when disabling Nagle's algorithm, you should group multiple packets sent during the same tick in one send buffer for the best performance.
  
 
== How do I open/save a command block? ==
 
== How do I open/save a command block? ==

Latest revision as of 13:33, 9 October 2024

People very, very often have questions regarding the Minecraft Modern Protocol, so we'll try to address some of the most common ones on this document. If you're still having trouble, join us on our discord or our IRC channel #mcdevs on irc.libera.chat.

Is the protocol documentation complete?

Depending on your definition, yes! All packet types are known and their layout documented. Some finer details are missing, but everything you need to make functional programs is present. We also collect information on the pre-release protocol changes, allowing us to quickly document new releases.

What's the normal login sequence for a client?

(This is about joining a Minecraft server. See Microsoft Authentication Scheme for how to log in to a Minecraft account, and Protocol Encryption for details on player authentication during server login.)

The recommended login sequence as of 1.21 looks like this, where C is the client and S is the server:

  1. Client connects to the server
  2. CS: Handshake State=2
  3. CS: Login Start
  4. SC: Encryption Request (optional)
  5. Client auth (Only if server sent Encryption Request)
  6. CS: Encryption Response (Only if server sent Encryption Request)
  7. Server auth, both enable encryption (Only if server sent Encryption Request)
  8. SC: Set Compression (Optional, enables compression)
  9. SC: Login Success
  10. CS: Login Acknowledged
  11. CS: Serverbound Plugin Message (Optional, minecraft:brand with the client's brand)
  12. CS: Client Information (Optional)
  13. SC: Clientbound Plugin Message (Optional, minecraft:brand with the server's brand)
  14. SC: Feature Flags (Optional)
  15. SC: Clientbound Known Packs
  16. CS: Serverbound Known Packs
  17. SC: Registry Data (Multiple)
  18. SC: Update Tags (Optional)
  19. SC: Finish Configuration
  20. CS: Acknowledge Finish Configuration
  21. SC: Login (play)
  22. SC: Change Difficulty (Optional)
  23. SC: Player Abilities (Optional)
  24. SC: Set Held Item (Optional)
  25. SC: Update Recipes (Optional)
  26. SC: Entity Event (Optional, for the OP permission level; see Entity statuses#Player)
  27. SC: Commands (Optional)
  28. SC: Update Recipe Book (Optional)
  29. SC: Synchronize Player Position
  30. CS: Confirm Teleportation
  31. CS: Set Player Position and Rotation (Optional, to confirm the spawn position)
  32. SC: Server Data (Optional)
  33. SC: Player Info Update (Add Player action, all players except the one joining (the Notchian server separates these, you don't need to))
  34. SC: Player Info Update (Add Player action, joining player)
  35. SC: Initialize World Border (Optional)
  36. SC: Update Time (Optional)
  37. SC: Set Default Spawn Position (Optional, “home” spawn, not where the client will spawn on login)
  38. SC: Game Event (Start waiting for level chunks event, required for the client to spawn)
  39. SC: Set Ticking State (Optional)
  40. SC: Step Tick (Optional, the Notchian server sends this regardless of ticking state)
  41. SC: Set Center Chunk
  42. SC: Chunk Data and Update Light (One sent for each chunk in a circular area centered on the player's position)
  43. SC: inventory, entities, etc.

Offline mode

If the Notchian server is in offline mode, it will not send the Encryption Request packet, and likewise, the client should not send Encryption Response. In this case, encryption is never enabled, and no authentication is performed.

Clients can tell that a server is in offline mode if the server sends a Login Success without sending Encryption Request.

Versions 1.20.5 and newer support protocol encryption in offline mode, in which case the Encryption Request packet can be sent with Should Authenticate set to false, and both the client and server should not authenticate with Mojang. However, it's currently not possible to configure the Notchian server to do this.

What does the normal status ping sequence look like?

When a Notchian client and server exchange information in a status ping, the exchange of packets will be as follows:

  1. CS: Handshake with Next State set to 1 (Status)
  2. Client and Server set protocol state to Status.
  3. CS: Status Request
  4. SC: Status Response
  5. CS: Ping Request
  6. SC: Ping Response
  7. Both sides close the connection

(Note that C is the Notchian client and S is the Notchian server).

I think I've done everything right, but…

…my player isn't spawning!

The Minecraft client will wait at the "Loading Terrain..." screen until late in the login sequence. As of 1.21, in order for the client to spawn, it must have received a Game Event packet with event 13 ("Start waiting for level chunks"), and at least one of the following conditions must be met:

The client will also spawn after spending 30 seconds in the loading screen, even if it never received Game Event 13.

In past versions, you could either (1.19.3 through 1.20.1) send the default spawn position packet or (pre-1.19.3) send the player position packet. In general, try sending packets that inform the client about the player's position in the world in order to get past the loading terrain screen.

In version 1.21, it became required to send the known packs packet with minecraft:core version 1.21.

As of 1.21, the minimum packets that need to be received and sent by the server in order to get the client past the loading terrain screen and into the world appear to be:

  1. Receive Handshake
  2. Receive Login Start
  3. Send Login Success
  4. Receive Login Acknowledged
  5. Send Clientbound Known Packs
  6. Receive Serverbound Known Packs
  7. Send multiple Registry Data
  8. Send Finish Configuration
  9. Receive Acknowledge Finish Configuration
  10. Send Login (Play)
  11. Send Game Event, Start waiting for level chunks
  12. Send Chunk Data and Update Light and/or Synchronize Player Position (see above)

The most difficult part of this may be sending any necessary NBTs in the Registry Data packet. Note that if you tell the Notchian client you have 0 known packs, it will blatantly lie to you, so you will probably need to record one from the standard server and replay it. Or you can find someone who has done that already, for example in Norbiros' gist. You can also find JSON representation of this packet in PrismarineJS/minecraft-data repo on GitHub.

…chunks are randomly showing and disappearing!

The Notchian client only reliably renders chunks surrounded by other loaded chunks on all sides. See Chunk Format#Tips and notes.

…the client is trying to send an invalid packet that begins with 0xFE01

The client is attempting a legacy ping, this happens if your server did not respond to the Server List Ping properly, including if it sent malformed JSON.

…the client disconnects after some time with a "Timed out" error

The server is expected to send a Keep Alive packet every 1-15 seconds (if the server does not send a keep alive within 20 seconds of state change to Play, the client will disconnect from the server for Timed Out), and the client should respond with the serverbound version of that packet. If either party does not receive keep alives for some period of time, they will disconnect.

...some of the packets I expect to receive seem to be missing or too short

You may be misusing the socket API. In particular, it is invalid to assume that the amount of data returned by calls to recv (or equivalent, depending on the API you're using) relates to packet boundaries in any way. There are no "borders" in a TCP data stream, only bytes. Regardless of how any two consecutive packets are sent, the receiver may get one packet, then the other, both at once, half of one, then the rest of both, or any other permutation of buffer sizes adding up to the total size of the packets. The only correct way to know where one packet ends and another begins is the packet length field, and you need to be prepared to handle multiple packets in one buffer, packets split across multiple buffers, etc. (as well as length fields split across multiple buffers!)

Similarly, depending on the API being used, a send call may also not guarantee that its whole input buffer is sent (consult the relevant documentation for details). This may also cause the connection to appear to hang during the login process, since the server will be left waiting indefinitely for the rest of the packet to arrive.

One reason why packets sent separately may arrive at once is Nagle's algorithm, a feature of many TCP implementations intended to improve efficiency particularly for applications making lots of small send calls. It is not the only reason, though, and disabling it should not be seen as a solution to the problem discussed here. Nonetheless, the delays it introduces are detrimental to real-time applications like Minecraft, so the Notchian client and server disable it, and you should too. This is typically done by enabling a socket option called TCP_NODELAY. Especially when disabling Nagle's algorithm, you should group multiple packets sent during the same tick in one send buffer for the best performance.

How do I open/save a command block?

The process to actually open the command block window clientside is somewhat complex; the client actually uses the Update Block Entity (0x09) packet to open it.

First, the client must have at least an OP permission level of 2, or else the client will refuse to open the command block. (The op permission level is set with the Entity Status packet)

To actually open the command block:

  1. CS: Player Block Placement (0x1C), with the position being the command block that was right-clicked.
  2. SC: Update Block Entity (0x09), with the NBT of the command block.

And to save it, use the MC|AutoCmd plugin channel.