Difference between revisions of "Protocol FAQ"

From wiki.vg
Jump to navigation Jump to search
m (Removed prechunks)
(70 intermediate revisions by 33 users not shown)
Line 1: Line 1:
People very, very often have questions regarding the Minecraft Modern [[Protocol]], so we'll try to address some of the most common ones on this document. If you're still having trouble, join us on IRC, channel #mcdevs on irc.freenode.net.
+
People very, very often have questions regarding the Minecraft Modern [[Protocol]], so we'll try to address some of the most common ones on this document. If you're still having trouble, join us on IRC, channel [ircs://irc.libera.chat:6697/mcdevs #mcdevs on irc.libera.chat].
  
===Is the protocol documentation complete?===
+
== Is the protocol documentation complete? ==
<blockquote>
+
Depending on your definition, ''yes''! All packet types are known and their layout documented. Some finer details are missing, but everything you need to make functional programs is present. We also collect information on the [[pre-release protocol]] changes, allowing us to quickly document new releases.
Depending on your definition, '''yes'''! All packet types are known and their layout documented. Some finer details are missing, but everything you need to make functional programs is present. We [[MC-Ver|have a script]] that monitors for new versions of the client and notifies us, allowing us to quickly document new packets.
 
</blockquote>
 
  
===What's the normal login sequence for a client?===
+
== What's the normal login sequence for a client? ==
 +
See [[Authentication]] for communication with Mojang's servers.
  
See [[Authentication]] for communication with minecraft.net
+
The recommended login sequence as of 1.20.4 looks like this, where '''C''' is the client and '''S''' is the server:
 +
# Client connects to the server
 +
# '''C'''→'''S''': [[Protocol#Handshake|Handshake]] State=2
 +
# '''C'''→'''S''': [[Protocol#Login Start|Login Start]]
 +
# '''S'''→'''C''': [[Protocol#Encryption Request|Encryption Request]]
 +
# Client auth
 +
# '''C'''→'''S''': [[Protocol#Encryption Response|Encryption Response]]
 +
# Server auth, both enable encryption
 +
# '''S''' → '''C''': [[Protocol#Set Compression|Set Compression]] (Optional, enables compression)
 +
# '''S''' → '''C''': [[Protocol#Login Success|Login Success]]
 +
# '''C''' → '''S''': [[Protocol#Login Acknowledged|Login Acknowledged]]
 +
# '''C''' → '''S''': [[Protocol#Serverbound Plugin Message (configuration)|Serverbound Plugin Message]] (Optional, [[Plugin channel#minecraft%3Abrand|<code>minecraft:brand</code>]] with the client's brand)
 +
# '''C''' → '''S''': [[Protocol#Client Information (configuration)|Client Information]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Clientbound Plugin Message (configuration)|Clientbound Plugin Message]] (Optional, [[Plugin channel#minecraft%3Abrand|<code>minecraft:brand</code>]] with the server's brand)
 +
# '''S''' → '''C''': [[Protocol#Feature Flags|Feature Flags]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Registry Data|Registry Data]]
 +
# '''S''' → '''C''': [[Protocol#Update Tags (configuration)|Update Tags]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Finish Configuration|Finish Configuration]]
 +
# '''C''' → '''S''': [[Protocol#Acknowledge Finish Configuration|Acknowledge Finish Configuration]]
 +
# '''S''' → '''C''': [[Protocol#Login (play)|Login (play)]]
 +
# '''S''' → '''C''': [[Protocol#Change Difficulty|Change Difficulty]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Player Abilities (clientbound)|Player Abilities]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Set Held Item (clientbound)|Set Held Item]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Update Recipes|Update Recipes]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Entity Event|Entity Event]] (Optional, for the {{Minecraft Wiki|Server.properties#op-permission-level|OP permission level}}; see [[Entity statuses#Player]])
 +
# '''S''' → '''C''': [[Protocol#Commands|Commands]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Update Recipe Book|Update Recipe Book]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Synchronize Player Position|Synchronize Player Position]]
 +
# '''C''' → '''S''': [[Protocol#Confirm Teleportation|Confirm Teleportation]]
 +
# '''C''' → '''S''': [[Protocol#Set Player Position and Rotation|Set Player Position and Rotation]] (Optional, to confirm the spawn position)
 +
# '''S''' → '''C''': [[Protocol#Server Data|Server Data]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Player Info Update|Player Info Update]] (Add Player action, all players except the one joining (the Notchian server separates these, you don't need to))
 +
# '''S''' → '''C''': [[Protocol#Player Info Update|Player Info Update]] (Add Player action, joining player)
 +
# '''S''' → '''C''': [[Protocol#Initialize World Border|Initialize World Border]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Update Time|Update Time]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Set Default Spawn Position|Set Default Spawn Position]] (Optional, “home” spawn, not where the client will spawn on login)
 +
# '''S''' → '''C''': [[Protocol#Game Event|Game Event]] (Start waiting for level chunks event, required for the client to spawn)
 +
# '''S''' → '''C''': [[Protocol#Set Ticking State|Set Ticking State]] (Optional)
 +
# '''S''' → '''C''': [[Protocol#Step Tick|Step Tick]] (Optional, the Notchian server sends this regardless of ticking state)
 +
# '''S''' → '''C''': [[Protocol#Set Center Chunk|Set Center Chunk]]
 +
# '''S''' → '''C''': [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]] (One sent for each chunk in a circular area centered on the player's position)
 +
# '''S''' → '''C''': inventory, entities, etc.
  
<blockquote>
+
== What does the normal status ping sequence look like? ==
The recommended login sequence looks like this, where C is the client and S is the server:<br /><br />
+
When a Notchian client and server exchange information in a status ping, the exchange of packets will be as follows:
  
#Client connects to server
+
# '''C''' '''S''': [[Protocol#Handshake|Handshake]] with Next State set to 1 ([[Protocol#Status|Status]])
#'''C->S''' 0x02 handshake
+
# Client and Server set protocol state to [[Protocol#Status|Status]].
#'''S->C''' 0xFD encryption request - server sends its public key and 4 random bytes
+
# '''C''' '''S''': [[Protocol#Status Request|Status Request]]
#Client generates symmetric key (shared secret)
+
# '''S''' '''C''': [[Protocol#Status Response|Status Response]]
#Client authenticates via session.minecraft.net
+
# '''C''' '''S''': [[Protocol#Ping Request (status)|Ping Request]]
#Client encrypts these 4 bytes with the servers public key.
+
# '''S''' '''C''': [[Protocol#Ping Response (status)|Ping Response]]
#'''C->S''' 0xFC encryption response - client encrypts shared secret with server's public key and sends along with encrypted 4 bytes
+
# Both sides close the connection
#Server checks that the encrypted bytes match
 
#Server decrypts shared secret with its private key
 
#Server checks player authenticity via session.minecraft.net
 
#'''S->C''' 0xFC encryption response - empty payload meaning two zero length byte arrays and two zero shorts
 
#Server enables AES stream encryption
 
#Client enables AES stream encryption
 
#'''C->S''' 0xCD - Payload of 0 (byte)
 
#'''S->C''' : Either kicks (invalid login) or sends a login response
 
#'''S->C''' : Sends chunks and entities
 
#'''S->C''' : Sends spawn position
 
#'''S->C''' : Sends inventory [Need to verify this since inventory changed] (beta 1.1_02: looks like Window items with type=0, then a Set slot with window id = -1 and slot = -1)
 
#'''S->C''' : Tell the client they're ready to spawn by sending a position + look packet. '''Note''': The stance and Y should be swapped when the server sends it to the client (See [[protocol#player_position_look_0x0d|Protocol Page]])!
 
#'''C->S''' : Sends a position + look packet to confirm the spawn position, with the stance and Y swapped back to the correct positions
 
</blockquote>
 
  
===I think I've done everything right, but…===
+
(Note that '''C''' is the Notchian client and '''S''' is the Notchian server).
  
====…my player isn't spawning!====
+
== Offline mode ==
<blockquote>
+
If the server is in offline mode, it will not send the [[Protocol#Encryption Request|Encryption Request]] packet, and likewise, the client should not send [[Protocol#Encryption Response|Encryption Response]]. In this case, encryption is never enabled, and no authentication is performed.
After sending the common-sense packets ([[protocol#handshake_0x02|Handshake]], [[protocol#login_request_0x01|Login]], [[protocol#player_inventory_0x05|Inventory]], [[protocol#spawn_position_0x06|Compass]] and [[protocol#pre-chunk_0x32|Pre-chunk]]/[[protocol#map_chunk_0x33|Chunk]] pairs) you need to finally send the player their [[protocol#player_position_look_0x0d|initial position]] for them to leave the "Loading Map" screen.
 
</blockquote>
 
  
====…my client isn't receiving complete map chunks!====
+
Clients can tell that a server is in offline mode if the server sends a [[Protocol#Login Success|Login Success]] without sending [[Protocol#Encryption Request|Encryption Request]].
''Main article: [[How to Write a Client]]''
 
<blockquote>
 
The standard Minecraft server sends full chunks only when your client is sending player status update packets (any of [[protocol#Player (0x0A)|Player (0x0A)]] through [[protocol#Player Position & Look (0x0D)|Player Position & Look (0x0D)]]).
 
</blockquote>
 
  
====…all connecting clients spasm and jerk uncontrollably!====
+
== I think I've done everything right, but… ==
<blockquote>
+
=== …my player isn't spawning! ===
For newer clients, your server needs to send 49 chunks ahead of time, not just one. Send a 7x7 square of chunks, centered on the connecting client's position, '''before''' spawning them.
+
 
</blockquote>
+
The Minecraft client will wait at the "Loading Terrain..." screen until late in the login sequence. As of 1.20.4, in order for the client to spawn, it must have received a [[Protocol#Game Event|Game Event]] packet with event 13 ("Start waiting for level chunks"), and at least one of the following conditions must be met:
 +
 
 +
* The player is in a loaded chunk (sent via [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]]).
 +
* The player is below the minimum world height or above the maximum world height (teleported via [[Protocol#Synchronize Player Position|Synchronize Player Position]]).
 +
* The player in spectator mode.
 +
* The player is dead (set via [[Protocol#Set Health|Set Health]] or [[Protocol#Combat Death|Combat Death]]).
 +
 
 +
In past versions, you could either (1.19.3 through 1.20.1) send the default spawn position packet or (pre-1.19.3) send the player position packet. In general, try sending packets that inform the client about the player's position in the world in order to get past the loading terrain screen.
 +
 
 +
As of 1.20.4, the minimum packets that need to be received and sent by the server in order to get the client past the loading terrain screen and into the world appear to be:
 +
 
 +
# Receive [[Protocol#Handshake|Handshake]]
 +
# Receive [[Protocol#Login Start|Login Start]]
 +
# Send [[Protocol#Login Success|Login Success]]
 +
# Receive [[Protocol#Login Acknowledged|Login Acknowledged]]
 +
# Send [[Protocol#Registry Data|Registry Data]]
 +
# Send [[Protocol#Finish Configuration|Finish Configuration]]
 +
# Receive [[Protocol#Acknowledge Finish Configuration|Acknowledge Finish Configuration]]
 +
# Send [[Protocol#Login .28play.29|Login (Play)]]
 +
# Send [[Protocol#Game Event|Game Event]], Start waiting for level chunks
 +
# Send [[Protocol#Chunk Data and Update Light|Chunk Data and Update Light]] and/or [[Protocol#Synchronize Player Position|Synchronize Player Position]] (see above)
 +
 
 +
The most difficult part of this may be sending any necessary NBTs in the [[Protocol#Registry_Data|Registry Data]] packet. You will probably need to record one from the standard server and replay it. Or you can find someone who has done that already, for example in [https://gist.github.com/Norbiros/f604ce46821e68c50260a169a9921560 Norbiros' gist]. You can also find JSON representation of this packet in [https://github.com/PrismarineJS/minecraft-data/blob/master/data/pc/1.20.2/loginPacket.json PrismarineJS/minecraft-data repo on GitHub].
 +
 
 +
=== …chunks are randomly showing and disappearing! ===
 +
The Notchian client only reliably renders chunks surrounded by other loaded chunks on all sides. See [[Chunk Format#Tips and notes]].
 +
 
 +
=== …the client is trying to send an invalid packet that begins with 0xFE01 ===
 +
The client is attempting a [[Server_List_Ping#1.6|legacy ping]], this happens if your server did not respond to the [[Server List Ping]] properly, including if it sent malformed JSON.
 +
 
 +
=== …the client disconnects after some time with a "Timed out" error ===
 +
The server is expected to send a [[Protocol#Keep Alive (clientbound)|Keep Alive]] packet every 1-15 seconds (if the server does not send a keep alive within 20 seconds of state change to Play, the client will disconnect from the server for '''Timed Out'''), and the client should respond with the serverbound version of that packet. If either party does not receive keep alives for some period of time, they will disconnect.
 +
 
 +
=== ...some of the packets I expect to receive seem to be missing or too short ===
 +
 
 +
You may be misusing the socket API. In particular, it is invalid to assume that the amount of data returned by calls to <code>recv</code> (or equivalent, depending on the API you're using) relates to packet boundaries in any way. There are no "borders" in a [[wikipedia:Transmission Control Protocol|TCP]] data stream, only bytes. Regardless of how any two consecutive packets are sent, the receiver may get one packet, then the other, both at once, half of one, then the rest of both, or any other permutation of buffer sizes adding up to the total size of the packets. The only correct way to know where one packet ends and another begins is the packet length field, and you need to be prepared to handle multiple packets in one buffer, packets split across multiple buffers, etc. (as well as length fields split across multiple buffers!)
 +
 
 +
Similarly, depending on the API being used, a <code>send</code> call may also not guarantee that its whole input buffer is sent (consult the relevant documentation for details). This may also cause the connection to appear to hang during the login process, since the server will be left waiting indefinitely for the rest of the packet to arrive.
 +
 
 +
One reason why packets sent separately may arrive at once is [[wikipedia:Nagle's algorithm|Nagle's algorithm]], a feature of many TCP implementations intended to improve efficiency particularly for applications making lots of small <code>send</code> calls. It is not the ''only'' reason, though, and disabling it should not be seen as a solution to the problem discussed here. Nonetheless, the delays it introduces are detrimental to real-time applications like Minecraft, so the Notchian client and server disable it, and you should too. This is typically done by enabling a socket option called <code>TCP_NODELAY</code>. Especially when disabling Nagle's algorithm, you should group multiple packets sent during the same tick in one send buffer for the best performance.
 +
 
 +
== How do I open/save a command block? ==
 +
The process to actually open the command block window clientside is somewhat complex; the client actually uses the [[Protocol#Update Block Entity|Update Block Entity (0x09)]] packet to open it.
 +
 
 +
First, the client must have at least an {{Minecraft Wiki|Server.properties#op-permission-level|OP permission level}} of 2, or else the client will refuse to open the command block.  (The op permission level is set with the [[Protocol#Entity Status|Entity Status]] packet)
 +
 
 +
To actually open the command block:
 +
 
 +
# '''C'''→'''S''': [[Protocol#Player Block Placement|Player Block Placement (0x1C)]], with the position being the command block that was right-clicked.
 +
# '''S'''→'''C''': [[Protocol#Update Block Entity|Update Block Entity (0x09)]], with the NBT of the command block.
 +
 
 +
And to save it, use the [[Plugin channels#MC.7CAutoCmd|<code>MC|AutoCmd</code> plugin channel]].
  
 
[[Category:Protocol Details]]
 
[[Category:Protocol Details]]
 
[[Category:Minecraft Modern]]
 
[[Category:Minecraft Modern]]

Revision as of 19:47, 18 March 2024

People very, very often have questions regarding the Minecraft Modern Protocol, so we'll try to address some of the most common ones on this document. If you're still having trouble, join us on IRC, channel #mcdevs on irc.libera.chat.

Is the protocol documentation complete?

Depending on your definition, yes! All packet types are known and their layout documented. Some finer details are missing, but everything you need to make functional programs is present. We also collect information on the pre-release protocol changes, allowing us to quickly document new releases.

What's the normal login sequence for a client?

See Authentication for communication with Mojang's servers.

The recommended login sequence as of 1.20.4 looks like this, where C is the client and S is the server:

  1. Client connects to the server
  2. CS: Handshake State=2
  3. CS: Login Start
  4. SC: Encryption Request
  5. Client auth
  6. CS: Encryption Response
  7. Server auth, both enable encryption
  8. SC: Set Compression (Optional, enables compression)
  9. SC: Login Success
  10. CS: Login Acknowledged
  11. CS: Serverbound Plugin Message (Optional, minecraft:brand with the client's brand)
  12. CS: Client Information (Optional)
  13. SC: Clientbound Plugin Message (Optional, minecraft:brand with the server's brand)
  14. SC: Feature Flags (Optional)
  15. SC: Registry Data
  16. SC: Update Tags (Optional)
  17. SC: Finish Configuration
  18. CS: Acknowledge Finish Configuration
  19. SC: Login (play)
  20. SC: Change Difficulty (Optional)
  21. SC: Player Abilities (Optional)
  22. SC: Set Held Item (Optional)
  23. SC: Update Recipes (Optional)
  24. SC: Entity Event (Optional, for the OP permission level; see Entity statuses#Player)
  25. SC: Commands (Optional)
  26. SC: Update Recipe Book (Optional)
  27. SC: Synchronize Player Position
  28. CS: Confirm Teleportation
  29. CS: Set Player Position and Rotation (Optional, to confirm the spawn position)
  30. SC: Server Data (Optional)
  31. SC: Player Info Update (Add Player action, all players except the one joining (the Notchian server separates these, you don't need to))
  32. SC: Player Info Update (Add Player action, joining player)
  33. SC: Initialize World Border (Optional)
  34. SC: Update Time (Optional)
  35. SC: Set Default Spawn Position (Optional, “home” spawn, not where the client will spawn on login)
  36. SC: Game Event (Start waiting for level chunks event, required for the client to spawn)
  37. SC: Set Ticking State (Optional)
  38. SC: Step Tick (Optional, the Notchian server sends this regardless of ticking state)
  39. SC: Set Center Chunk
  40. SC: Chunk Data and Update Light (One sent for each chunk in a circular area centered on the player's position)
  41. SC: inventory, entities, etc.

What does the normal status ping sequence look like?

When a Notchian client and server exchange information in a status ping, the exchange of packets will be as follows:

  1. CS: Handshake with Next State set to 1 (Status)
  2. Client and Server set protocol state to Status.
  3. CS: Status Request
  4. SC: Status Response
  5. CS: Ping Request
  6. SC: Ping Response
  7. Both sides close the connection

(Note that C is the Notchian client and S is the Notchian server).

Offline mode

If the server is in offline mode, it will not send the Encryption Request packet, and likewise, the client should not send Encryption Response. In this case, encryption is never enabled, and no authentication is performed.

Clients can tell that a server is in offline mode if the server sends a Login Success without sending Encryption Request.

I think I've done everything right, but…

…my player isn't spawning!

The Minecraft client will wait at the "Loading Terrain..." screen until late in the login sequence. As of 1.20.4, in order for the client to spawn, it must have received a Game Event packet with event 13 ("Start waiting for level chunks"), and at least one of the following conditions must be met:

In past versions, you could either (1.19.3 through 1.20.1) send the default spawn position packet or (pre-1.19.3) send the player position packet. In general, try sending packets that inform the client about the player's position in the world in order to get past the loading terrain screen.

As of 1.20.4, the minimum packets that need to be received and sent by the server in order to get the client past the loading terrain screen and into the world appear to be:

  1. Receive Handshake
  2. Receive Login Start
  3. Send Login Success
  4. Receive Login Acknowledged
  5. Send Registry Data
  6. Send Finish Configuration
  7. Receive Acknowledge Finish Configuration
  8. Send Login (Play)
  9. Send Game Event, Start waiting for level chunks
  10. Send Chunk Data and Update Light and/or Synchronize Player Position (see above)

The most difficult part of this may be sending any necessary NBTs in the Registry Data packet. You will probably need to record one from the standard server and replay it. Or you can find someone who has done that already, for example in Norbiros' gist. You can also find JSON representation of this packet in PrismarineJS/minecraft-data repo on GitHub.

…chunks are randomly showing and disappearing!

The Notchian client only reliably renders chunks surrounded by other loaded chunks on all sides. See Chunk Format#Tips and notes.

…the client is trying to send an invalid packet that begins with 0xFE01

The client is attempting a legacy ping, this happens if your server did not respond to the Server List Ping properly, including if it sent malformed JSON.

…the client disconnects after some time with a "Timed out" error

The server is expected to send a Keep Alive packet every 1-15 seconds (if the server does not send a keep alive within 20 seconds of state change to Play, the client will disconnect from the server for Timed Out), and the client should respond with the serverbound version of that packet. If either party does not receive keep alives for some period of time, they will disconnect.

...some of the packets I expect to receive seem to be missing or too short

You may be misusing the socket API. In particular, it is invalid to assume that the amount of data returned by calls to recv (or equivalent, depending on the API you're using) relates to packet boundaries in any way. There are no "borders" in a TCP data stream, only bytes. Regardless of how any two consecutive packets are sent, the receiver may get one packet, then the other, both at once, half of one, then the rest of both, or any other permutation of buffer sizes adding up to the total size of the packets. The only correct way to know where one packet ends and another begins is the packet length field, and you need to be prepared to handle multiple packets in one buffer, packets split across multiple buffers, etc. (as well as length fields split across multiple buffers!)

Similarly, depending on the API being used, a send call may also not guarantee that its whole input buffer is sent (consult the relevant documentation for details). This may also cause the connection to appear to hang during the login process, since the server will be left waiting indefinitely for the rest of the packet to arrive.

One reason why packets sent separately may arrive at once is Nagle's algorithm, a feature of many TCP implementations intended to improve efficiency particularly for applications making lots of small send calls. It is not the only reason, though, and disabling it should not be seen as a solution to the problem discussed here. Nonetheless, the delays it introduces are detrimental to real-time applications like Minecraft, so the Notchian client and server disable it, and you should too. This is typically done by enabling a socket option called TCP_NODELAY. Especially when disabling Nagle's algorithm, you should group multiple packets sent during the same tick in one send buffer for the best performance.

How do I open/save a command block?

The process to actually open the command block window clientside is somewhat complex; the client actually uses the Update Block Entity (0x09) packet to open it.

First, the client must have at least an OP permission level of 2, or else the client will refuse to open the command block. (The op permission level is set with the Entity Status packet)

To actually open the command block:

  1. CS: Player Block Placement (0x1C), with the position being the command block that was right-clicked.
  2. SC: Update Block Entity (0x09), with the NBT of the command block.

And to save it, use the MC|AutoCmd plugin channel.